[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:18:59 dist-test-slave-6nmv krb5kdc[1973](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:18:59 dist-test-slave-6nmv krb5kdc[1973](info): set up 2 sockets
Aug 09 23:18:59 dist-test-slave-6nmv krb5kdc[1973](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 23:19:00.227586 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.053s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:19:00 dist-test-slave-6nmv krb5kdc[1973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317540, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:19:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:19:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:19:00.340461 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:36211
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:42093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:36211
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:00.423846 1987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:00.424046 1987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:00.424068 1987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:00.425199 1987 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:00.425246 1987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:00.425261 1987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:00.425274 1987 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:00.425328 1987 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:19:00.426841 1987 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:42093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:36211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:36211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:00.427243 1987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:00.427551 1987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:00.434558 1997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:00.434592 1995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:00.434559 1994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:00.435606 1987 server_base.cc:1034] running on GCE node
I20260809 23:19:00.435956 1987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:00.436378 1987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:00.437549 1987 hybrid_clock.cc:648] HybridClock initialized: now 1786317540437545 us; error 56 us; skew 500 ppm
Aug 09 23:19:00 dist-test-slave-6nmv krb5kdc[1973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317540, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:00.440177 1987 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:19:00.440768 1987 webserver.cc:460] Webserver started at http://127.1.235.190:33529/ using document root <none> and password file <none>
I20260809 23:19:00.441004 1987 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:00.441047 1987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:00.441167 1987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:00.442606 1987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "4203eed6db3843b9beee9852ca688110"
format_stamp: "Formatted at 2026-08-09 23:19:00 on dist-test-slave-6nmv"
server_key: "89b0752523e5351868487426fc9471c3"
server_key_iv: "f4ea80f62c32bb6ca907ead55b9e3a9a"
server_key_version: "encryptionkey@0"
I20260809 23:19:00.443225 1987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "4203eed6db3843b9beee9852ca688110"
format_stamp: "Formatted at 2026-08-09 23:19:00 on dist-test-slave-6nmv"
server_key: "89b0752523e5351868487426fc9471c3"
server_key_iv: "f4ea80f62c32bb6ca907ead55b9e3a9a"
server_key_version: "encryptionkey@0"
I20260809 23:19:00.445094 1987 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s
I20260809 23:19:00.446039 2005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:00.446331 1987 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:00.446429 1987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "4203eed6db3843b9beee9852ca688110"
format_stamp: "Formatted at 2026-08-09 23:19:00 on dist-test-slave-6nmv"
server_key: "89b0752523e5351868487426fc9471c3"
server_key_iv: "f4ea80f62c32bb6ca907ead55b9e3a9a"
server_key_version: "encryptionkey@0"
I20260809 23:19:00.446498 1987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:00.458679 1987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:00.460656 1987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:00.460852 1987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:00.469322 1987 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:36211
I20260809 23:19:00.469417 2070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:36211 every 8 connection(s)
I20260809 23:19:00.469993 1987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:19:00.471439 2071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:00.475149 2071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110: Bootstrap starting.
I20260809 23:19:00.475204 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 1987
I20260809 23:19:00.475306 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:19:00.476013 1966 external_mini_cluster.cc:1428] Setting key a39a5f0f09cf1f3242625e0cd6be5be9
I20260809 23:19:00.476249 2071 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:00.477048 2071 log.cc:824] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:00.478106 2071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110: No bootstrap required, opened a new log
I20260809 23:19:00.481210 2071 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4203eed6db3843b9beee9852ca688110" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 36211 } }
I20260809 23:19:00.481436 2071 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:00.481539 2071 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4203eed6db3843b9beee9852ca688110, State: Initialized, Role: FOLLOWER
I20260809 23:19:00.481738 2071 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4203eed6db3843b9beee9852ca688110" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 36211 } }
I20260809 23:19:00.481911 2071 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:19:00.481957 2071 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:19:00.482009 2071 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:00.483006 2071 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4203eed6db3843b9beee9852ca688110" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 36211 } }
I20260809 23:19:00.483202 2071 leader_election.cc:302] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4203eed6db3843b9beee9852ca688110; no voters:
I20260809 23:19:00.483439 2071 leader_election.cc:288] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:19:00.483465 2076 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:00.483861 2071 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:00.485509 2076 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [term 1 LEADER]: Becoming Leader. State: Replica: 4203eed6db3843b9beee9852ca688110, State: Running, Role: LEADER
I20260809 23:19:00.485657 2076 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4203eed6db3843b9beee9852ca688110" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 36211 } }
I20260809 23:19:00.486415 2077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4203eed6db3843b9beee9852ca688110" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4203eed6db3843b9beee9852ca688110" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 36211 } } }
I20260809 23:19:00.486521 2077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:00.486243 2090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4203eed6db3843b9beee9852ca688110. Latest consensus state: current_term: 1 leader_uuid: "4203eed6db3843b9beee9852ca688110" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4203eed6db3843b9beee9852ca688110" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 36211 } } }
I20260809 23:19:00.486953 2090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:00.487071 2097 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:19:00.488078 2097 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:19:00.490374 2097 catalog_manager.cc:1347] Generated new cluster ID: 4df91c595456495ebb58eca32c64f60a
I20260809 23:19:00.490435 2097 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 23:19:00 dist-test-slave-6nmv krb5kdc[1973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317540, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:00.496156 2097 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:19:00.496645 2097 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:19:00.497710 2075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:00.477307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34810 (local address 127.1.235.190:36211)
0809 23:19:00.477633 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:00.477643 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:00.478415 (+ 772us) server_negotiation.cc:407] Connection header received
0809 23:19:00.481191 (+ 2776us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:00.481196 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:00.481282 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:00.481433 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:00.483504 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:00.485197 (+ 1693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:00.486542 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:00.487296 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:00.487441 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:00.493165 (+ 5724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:00.493169 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:00.493169 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:00.493179 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:00.495209 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:00.495720 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:00.495723 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:00.495723 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:00.495834 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:00.496188 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:00.496189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:00.496189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:00.496464 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:00.496601 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:00.497039 (+ 438us) server_negotiation.cc:299] Negotiation successful
0809 23:19:00.497232 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":98,"threads_started":1}
I20260809 23:19:00.502972 2097 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4203eed6db3843b9beee9852ca688110: Generated new TSK 0
I20260809 23:19:00.503134 2097 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:19:00.528445 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:36211
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:42093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:00.620867 2106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:00.621223 2106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:00.621264 2106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:00.622928 2106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:00.622996 2106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:00.623044 2106 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:19:00.625164 2106 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:42093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:36211
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2106
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:00.625483 2106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:00.625730 2106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:00.633060 2113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:00.633324 2114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:00.633060 2116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:00.635007 2106 server_base.cc:1034] running on GCE node
I20260809 23:19:00.635223 2106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:00.635483 2106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:00.636636 2106 hybrid_clock.cc:648] HybridClock initialized: now 1786317540636628 us; error 28 us; skew 500 ppm
Aug 09 23:19:00 dist-test-slave-6nmv krb5kdc[1973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317540, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:00.639436 2106 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:19:00.640025 2106 webserver.cc:460] Webserver started at http://127.1.235.129:40945/ using document root <none> and password file <none>
I20260809 23:19:00.640280 2106 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:00.640353 2106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:00.640540 2106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:00.641662 2106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "3d308317132b4b8fa4f4d2a1cc07b4d0"
format_stamp: "Formatted at 2026-08-09 23:19:00 on dist-test-slave-6nmv"
server_key: "750500bbaa18e29ec49c48c645f39c2d"
server_key_iv: "bce53e5dbc513ad9af2798bb561c8926"
server_key_version: "encryptionkey@0"
I20260809 23:19:00.642071 2106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "3d308317132b4b8fa4f4d2a1cc07b4d0"
format_stamp: "Formatted at 2026-08-09 23:19:00 on dist-test-slave-6nmv"
server_key: "750500bbaa18e29ec49c48c645f39c2d"
server_key_iv: "bce53e5dbc513ad9af2798bb561c8926"
server_key_version: "encryptionkey@0"
I20260809 23:19:00.643601 2106 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:19:00.644358 2124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:00.644506 2106 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:19:00.644589 2106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "3d308317132b4b8fa4f4d2a1cc07b4d0"
format_stamp: "Formatted at 2026-08-09 23:19:00 on dist-test-slave-6nmv"
server_key: "750500bbaa18e29ec49c48c645f39c2d"
server_key_iv: "bce53e5dbc513ad9af2798bb561c8926"
server_key_version: "encryptionkey@0"
I20260809 23:19:00.644654 2106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:00.654069 2106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:00.656327 2106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:00.656488 2106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:00.656788 2106 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:00.657210 2106 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:00.657298 2106 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:00.657322 2106 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:00.657367 2106 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:00.665305 2106 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:36203
I20260809 23:19:00.665385 2252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:36203 every 8 connection(s)
I20260809 23:19:00.665681 2106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
Aug 09 23:19:00 dist-test-slave-6nmv krb5kdc[1973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317540, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:00.673584 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 2106
I20260809 23:19:00.673664 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:19:00.673862 1966 external_mini_cluster.cc:1428] Setting key 5f2f2a918032c8b4eeb662ec6fd9b607
I20260809 23:19:00.675246 2075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:00.666656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:60225 (local address 127.1.235.190:36211)
0809 23:19:00.666859 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:00.666861 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:00.667043 (+ 182us) server_negotiation.cc:407] Connection header received
0809 23:19:00.667560 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:00.667561 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:00.667574 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:00.667627 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:00.668669 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:00.669167 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:00.670187 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:00.670386 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:00.670462 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:00.672505 (+ 2043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:00.672507 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:00.672507 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:00.672515 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:00.673728 (+ 1213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:00.674260 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:00.674262 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:00.674263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:00.674328 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:00.674618 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:00.674619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:00.674620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:00.674734 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:00.674812 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:00.675073 (+ 261us) server_negotiation.cc:299] Negotiation successful
0809 23:19:00.675157 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171}
I20260809 23:19:00.675412 2255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:00.666562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:36211 (local address 127.1.235.129:60225)
0809 23:19:00.666911 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:00.666959 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:00.667457 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:00.667696 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:00.667700 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:00.668379 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:00.668567 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:00.668571 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:00.669264 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:00.669265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:00.670096 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:00.670098 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:00.670469 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:00.670470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:00.670608 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:00.671026 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:00.671033 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:00.672411 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:00.673802 (+ 1391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:00.673831 (+ 29us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:00.673833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:00.674181 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:00.674436 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:00.674437 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:00.674437 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:00.674563 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:00.674801 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:00.674807 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:00.674945 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 23:19:00.675050 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 23:19:00.675194 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":107,"threads_started":1}
I20260809 23:19:00.676086 2253 heartbeater.cc:347] Connected to a master server at 127.1.235.190:36211
I20260809 23:19:00.676190 2253 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:00.676370 2253 heartbeater.cc:511] Master 127.1.235.190:36211 requested a full tablet report, sending...
I20260809 23:19:00.677167 2023 ts_manager.cc:194] Registered new tserver with Master: 3d308317132b4b8fa4f4d2a1cc07b4d0 (127.1.235.129:36203)
I20260809 23:19:00.678071 2023 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:60225
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:19:00.700668 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:36211
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:42093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:00.780202 2258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:00.780413 2258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:00.780460 2258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:00.781577 2258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:00.781641 2258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:00.781687 2258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:19:00.783082 2258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:42093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:36211
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:00.783349 2258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:00.783587 2258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:00.788331 2267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:00.788341 2263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:00.788399 2264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:00.788729 2258 server_base.cc:1034] running on GCE node
I20260809 23:19:00.788895 2258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:00.789142 2258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:00.790282 2258 hybrid_clock.cc:648] HybridClock initialized: now 1786317540790268 us; error 28 us; skew 500 ppm
Aug 09 23:19:00 dist-test-slave-6nmv krb5kdc[1973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317540, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:00.792802 2258 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:19:00.793217 2258 webserver.cc:460] Webserver started at http://127.1.235.130:34291/ using document root <none> and password file <none>
I20260809 23:19:00.793432 2258 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:00.793500 2258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:00.793653 2258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:00.794755 2258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "21ed584348944d9c93279e2f6af56893"
format_stamp: "Formatted at 2026-08-09 23:19:00 on dist-test-slave-6nmv"
server_key: "dd09c64fa87171697d5e0cef4f1b0236"
server_key_iv: "6774edc67c06cb32e047284f2c7f31dd"
server_key_version: "encryptionkey@0"
I20260809 23:19:00.795117 2258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "21ed584348944d9c93279e2f6af56893"
format_stamp: "Formatted at 2026-08-09 23:19:00 on dist-test-slave-6nmv"
server_key: "dd09c64fa87171697d5e0cef4f1b0236"
server_key_iv: "6774edc67c06cb32e047284f2c7f31dd"
server_key_version: "encryptionkey@0"
I20260809 23:19:00.796504 2258 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:19:00.797170 2275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:00.797334 2258 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:00.797426 2258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "21ed584348944d9c93279e2f6af56893"
format_stamp: "Formatted at 2026-08-09 23:19:00 on dist-test-slave-6nmv"
server_key: "dd09c64fa87171697d5e0cef4f1b0236"
server_key_iv: "6774edc67c06cb32e047284f2c7f31dd"
server_key_version: "encryptionkey@0"
I20260809 23:19:00.797505 2258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:00.812460 2258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:00.814277 2258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:00.814425 2258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:00.814641 2258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:00.814980 2258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:00.815039 2258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:00.815073 2258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:00.815120 2258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:00.822217 2258 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:39841
I20260809 23:19:00.822249 2398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:39841 every 8 connection(s)
I20260809 23:19:00.822553 2258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:19:00.825139 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 2258
I20260809 23:19:00.825218 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:19:00.825397 1966 external_mini_cluster.cc:1428] Setting key f723ec65825b5b43577426c56531281c
Aug 09 23:19:00 dist-test-slave-6nmv krb5kdc[1973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317540, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:00.832207 2075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:00.823259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:60231 (local address 127.1.235.190:36211)
0809 23:19:00.823327 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:00.823330 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:00.823534 (+ 204us) server_negotiation.cc:407] Connection header received
0809 23:19:00.823959 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:00.823960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:00.823970 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:00.824015 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:00.824831 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:00.825341 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:00.826657 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:00.826827 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:00.826877 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:00.829333 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:00.829334 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:00.829334 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:00.829340 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:00.830783 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:00.831267 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:00.831267 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:00.831267 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:00.831314 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:00.831592 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:00.831593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:00.831593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:00.831709 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:00.831757 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:00.832088 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 23:19:00.832146 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 23:19:00.832499 2401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:00.823236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:36211 (local address 127.1.235.130:60231)
0809 23:19:00.823410 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:00.823444 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:00.823880 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:00.824063 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:00.824066 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:00.824579 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:00.824761 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:00.824769 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:00.825420 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:00.825421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:00.826583 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:00.826587 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:00.826905 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:00.826905 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:00.827065 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:00.827553 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:00.827563 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:00.829248 (+ 1685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:00.830861 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:00.830868 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:00.830870 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:00.831187 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:00.831373 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:00.831374 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:00.831374 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:00.831510 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:00.831775 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:00.831781 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:00.831948 (+ 167us) client_negotiation.cc:769] Sending connection context
0809 23:19:00.832072 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 23:19:00.832250 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":96,"threads_started":1}
I20260809 23:19:00.833050 2399 heartbeater.cc:347] Connected to a master server at 127.1.235.190:36211
I20260809 23:19:00.833132 2399 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:00.833297 2399 heartbeater.cc:511] Master 127.1.235.190:36211 requested a full tablet report, sending...
I20260809 23:19:00.833678 2023 ts_manager.cc:194] Registered new tserver with Master: 21ed584348944d9c93279e2f6af56893 (127.1.235.130:39841)
I20260809 23:19:00.834056 2023 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:60231
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:19:00.852088 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:36211
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:42093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:00.931800 2405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:00.932056 2405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:00.932106 2405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:00.933260 2405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:00.933328 2405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:00.933369 2405 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:19:00.934773 2405 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:42093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:36211
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:00.935042 2405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:00.935282 2405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:00.940181 2413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:00.940214 2410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:00.940176 2411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:00.940388 2405 server_base.cc:1034] running on GCE node
I20260809 23:19:00.940644 2405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:00.940886 2405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:00.942039 2405 hybrid_clock.cc:648] HybridClock initialized: now 1786317540942029 us; error 28 us; skew 500 ppm
Aug 09 23:19:00 dist-test-slave-6nmv krb5kdc[1973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317540, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:00.944337 2405 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:19:00.944722 2405 webserver.cc:460] Webserver started at http://127.1.235.131:33541/ using document root <none> and password file <none>
I20260809 23:19:00.944938 2405 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:00.945000 2405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:00.945138 2405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:00.946107 2405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "c8b5297cee154ecbbe977b1587e1071a"
format_stamp: "Formatted at 2026-08-09 23:19:00 on dist-test-slave-6nmv"
server_key: "07cf2556ee137b31068b44edfd01a32c"
server_key_iv: "dea070674a29755fa2219fc949f57c8c"
server_key_version: "encryptionkey@0"
I20260809 23:19:00.946452 2405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "c8b5297cee154ecbbe977b1587e1071a"
format_stamp: "Formatted at 2026-08-09 23:19:00 on dist-test-slave-6nmv"
server_key: "07cf2556ee137b31068b44edfd01a32c"
server_key_iv: "dea070674a29755fa2219fc949f57c8c"
server_key_version: "encryptionkey@0"
I20260809 23:19:00.947867 2405 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:19:00.948590 2420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:00.948767 2405 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:00.948855 2405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "c8b5297cee154ecbbe977b1587e1071a"
format_stamp: "Formatted at 2026-08-09 23:19:00 on dist-test-slave-6nmv"
server_key: "07cf2556ee137b31068b44edfd01a32c"
server_key_iv: "dea070674a29755fa2219fc949f57c8c"
server_key_version: "encryptionkey@0"
I20260809 23:19:00.948935 2405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:00.959671 2405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:00.961205 2405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:00.961344 2405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:00.961544 2405 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:00.961845 2405 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:00.961889 2405 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:00.961920 2405 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:00.961946 2405 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:00.968842 2405 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:34637
I20260809 23:19:00.968909 2539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:34637 every 8 connection(s)
I20260809 23:19:00.969203 2405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
Aug 09 23:19:00 dist-test-slave-6nmv krb5kdc[1973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317540, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:00.976701 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 2405
I20260809 23:19:00.976796 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:19:00.976964 1966 external_mini_cluster.cc:1428] Setting key 2de50f7cc439511b2ca16ec7d72b8906
I20260809 23:19:00.977644 2075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:00.969869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:47461 (local address 127.1.235.190:36211)
0809 23:19:00.969927 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:00.969929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:00.970126 (+ 197us) server_negotiation.cc:407] Connection header received
0809 23:19:00.970531 (+ 405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:00.970532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:00.970543 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:00.970588 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:00.971413 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:00.971889 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:00.972778 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:00.972960 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:00.973006 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:00.974977 (+ 1971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:00.974978 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:00.974979 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:00.974985 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:00.976302 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:00.976721 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:00.976722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:00.976722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:00.976790 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:00.977035 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:00.977036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:00.977036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:00.977140 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:00.977210 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:00.977484 (+ 274us) server_negotiation.cc:299] Negotiation successful
0809 23:19:00.977558 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 23:19:00.977838 2542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:00.969851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:36211 (local address 127.1.235.131:47461)
0809 23:19:00.970016 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:00.970045 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:00.970450 (+ 405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:00.970642 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:00.970645 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:00.971178 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:00.971340 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:00.971344 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:00.971964 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:00.971965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:00.972712 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:00.972713 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:00.973025 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:00.973026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:00.973126 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:00.973565 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:00.973572 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:00.974881 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:00.976364 (+ 1483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:00.976369 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:00.976370 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:00.976638 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:00.976857 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:00.976858 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:00.976858 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:00.976960 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:00.977239 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:00.977245 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:00.977356 (+ 111us) client_negotiation.cc:769] Sending connection context
0809 23:19:00.977464 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 23:19:00.977611 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":102,"threads_started":1}
I20260809 23:19:00.978219 2540 heartbeater.cc:347] Connected to a master server at 127.1.235.190:36211
I20260809 23:19:00.978312 2540 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:00.978435 2540 heartbeater.cc:511] Master 127.1.235.190:36211 requested a full tablet report, sending...
I20260809 23:19:00.978754 2023 ts_manager.cc:194] Registered new tserver with Master: c8b5297cee154ecbbe977b1587e1071a (127.1.235.131:34637)
I20260809 23:19:00.979122 2023 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:47461
I20260809 23:19:00.989005 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 23:19:00 dist-test-slave-6nmv krb5kdc[1973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317540, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 23:19:01 dist-test-slave-6nmv krb5kdc[1973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317540, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.235.129@KRBTEST.COM
I20260809 23:19:01.013935 2548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:01.004965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38912 (local address 127.1.235.129:36203)
0809 23:19:01.005183 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:01.005188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:01.005200 (+ 12us) server_negotiation.cc:407] Connection header received
0809 23:19:01.005227 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:01.005228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:01.005247 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:01.005308 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:01.005757 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:01.006457 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:01.007244 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:01.007563 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:01.007643 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:01.010495 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:01.010504 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:01.010505 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:01.010531 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:01.012466 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:01.012906 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:01.012909 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:01.012909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:01.012985 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:01.013187 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:01.013188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:01.013188 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:01.013352 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:01.013505 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:01.013732 (+ 227us) server_negotiation.cc:299] Negotiation successful
0809 23:19:01.013831 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":127,"threads_started":1}
W20260809 23:19:01.014412 2154 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38912
Aug 09 23:19:01 dist-test-slave-6nmv krb5kdc[1973](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317541, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 23:19:01 dist-test-slave-6nmv krb5kdc[1973](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317541, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.129@KRBTEST.COM
I20260809 23:19:01.040699 2548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:01.031868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38920 (local address 127.1.235.129:36203)
0809 23:19:01.031927 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:01.031929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:01.032022 (+ 93us) server_negotiation.cc:407] Connection header received
0809 23:19:01.032106 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:01.032107 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:01.032135 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:01.032208 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:01.032753 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:01.033247 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:01.034033 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:01.034387 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:01.034440 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:01.037496 (+ 3056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:01.037497 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:01.037497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:01.037506 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:01.039331 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:01.039746 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:01.039748 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:01.039749 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:01.039819 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:01.040070 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:01.040071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:01.040071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:01.040220 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:01.040351 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:01.040474 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 23:19:01.040566 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 23:19:01.041255 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 2106
I20260809 23:19:01.048317 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 2258
I20260809 23:19:01.056275 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 2405
I20260809 23:19:01.061247 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 1987
2026-08-09T23:19:01Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (1918 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:19:01 dist-test-slave-6nmv krb5kdc[2555](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:19:01 dist-test-slave-6nmv krb5kdc[2555](info): set up 2 sockets
Aug 09 23:19:01 dist-test-slave-6nmv krb5kdc[2555](info): commencing operation
krb5kdc: starting...
W20260809 23:19:02.106359 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:19:02 dist-test-slave-6nmv krb5kdc[2555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:19:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:19:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:19:02.226621 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:39557
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:40989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:39557
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:02.304436 2570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:02.304639 2570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:02.304673 2570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:02.305697 2570 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:02.305756 2570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:02.305778 2570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:02.305799 2570 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:02.305873 2570 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:19:02.307281 2570 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:40989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:39557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:39557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:02.307538 2570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:02.307737 2570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:02.312250 2578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:02.312306 2575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:02.312367 2576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:02.312630 2570 server_base.cc:1034] running on GCE node
I20260809 23:19:02.312875 2570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:02.313143 2570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:02.314278 2570 hybrid_clock.cc:648] HybridClock initialized: now 1786317542314270 us; error 30 us; skew 500 ppm
Aug 09 23:19:02 dist-test-slave-6nmv krb5kdc[2555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317542, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:02.316479 2570 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:19:02.316910 2570 webserver.cc:460] Webserver started at http://127.1.235.190:45123/ using document root <none> and password file <none>
I20260809 23:19:02.317114 2570 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:02.317153 2570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:02.317303 2570 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:02.318245 2570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "f0714c2305d9440681c073f9f91bf246"
format_stamp: "Formatted at 2026-08-09 23:19:02 on dist-test-slave-6nmv"
server_key: "3adf7b58997973cbed0a9423673715ef"
server_key_iv: "8d522ca62db861dc1fb65d23fd9e3975"
server_key_version: "encryptionkey@0"
I20260809 23:19:02.318602 2570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "f0714c2305d9440681c073f9f91bf246"
format_stamp: "Formatted at 2026-08-09 23:19:02 on dist-test-slave-6nmv"
server_key: "3adf7b58997973cbed0a9423673715ef"
server_key_iv: "8d522ca62db861dc1fb65d23fd9e3975"
server_key_version: "encryptionkey@0"
I20260809 23:19:02.319936 2570 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:19:02.320590 2585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:02.320767 2570 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:02.320859 2570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "f0714c2305d9440681c073f9f91bf246"
format_stamp: "Formatted at 2026-08-09 23:19:02 on dist-test-slave-6nmv"
server_key: "3adf7b58997973cbed0a9423673715ef"
server_key_iv: "8d522ca62db861dc1fb65d23fd9e3975"
server_key_version: "encryptionkey@0"
I20260809 23:19:02.320921 2570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:02.336472 2570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:02.338168 2570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:02.338315 2570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:02.342283 2570 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:39557
I20260809 23:19:02.342324 2640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:39557 every 8 connection(s)
I20260809 23:19:02.342679 2570 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:19:02.343453 2641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:02.345474 2641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246: Bootstrap starting.
I20260809 23:19:02.346014 2641 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:02.346294 2641 log.cc:824] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:02.346894 2641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246: No bootstrap required, opened a new log
I20260809 23:19:02.348269 2641 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0714c2305d9440681c073f9f91bf246" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39557 } }
I20260809 23:19:02.348410 2641 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:02.348433 2641 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0714c2305d9440681c073f9f91bf246, State: Initialized, Role: FOLLOWER
I20260809 23:19:02.348603 2641 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0714c2305d9440681c073f9f91bf246" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39557 } }
I20260809 23:19:02.348665 2641 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:19:02.348685 2641 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:19:02.348754 2641 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:02.349256 2641 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0714c2305d9440681c073f9f91bf246" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39557 } }
I20260809 23:19:02.349359 2641 leader_election.cc:302] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0714c2305d9440681c073f9f91bf246; no voters:
I20260809 23:19:02.349571 2641 leader_election.cc:288] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:19:02.349624 2644 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:02.349792 2644 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [term 1 LEADER]: Becoming Leader. State: Replica: f0714c2305d9440681c073f9f91bf246, State: Running, Role: LEADER
I20260809 23:19:02.349828 2641 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:02.349889 2644 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0714c2305d9440681c073f9f91bf246" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39557 } }
I20260809 23:19:02.350303 2645 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0714c2305d9440681c073f9f91bf246" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0714c2305d9440681c073f9f91bf246" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39557 } } }
I20260809 23:19:02.350318 2647 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0714c2305d9440681c073f9f91bf246. Latest consensus state: current_term: 1 leader_uuid: "f0714c2305d9440681c073f9f91bf246" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0714c2305d9440681c073f9f91bf246" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39557 } } }
I20260809 23:19:02.350508 2645 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:02.350535 2647 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:02.350885 2650 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:19:02.351058 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 2570
I20260809 23:19:02.351143 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:19:02.351296 1966 external_mini_cluster.cc:1428] Setting key 10f55172b35359e1c720be094d1d3fc5
I20260809 23:19:02.351352 2650 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:19:02.353008 2650 catalog_manager.cc:1347] Generated new cluster ID: bc7bcd5595ba46f58f18060674156668
I20260809 23:19:02.353060 2650 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 23:19:02 dist-test-slave-6nmv krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:02.361250 2665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.351974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36610 (local address 127.1.235.190:39557)
0809 23:19:02.352412 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:02.352419 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:02.352449 (+ 30us) server_negotiation.cc:407] Connection header received
0809 23:19:02.352564 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:02.352570 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:02.352622 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:02.352766 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:02.353431 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.354416 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.355197 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.355632 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.355746 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.358053 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:02.358058 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:02.358058 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:02.358069 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:02.359723 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:02.360094 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:02.360097 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:02.360097 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:02.360214 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:02.360424 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:02.360425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:02.360426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:02.360658 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:02.360822 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:02.360916 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 23:19:02.361062 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":78,"threads_started":1}
I20260809 23:19:02.386976 2650 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:19:02.387466 2650 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:19:02.393666 2650 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0714c2305d9440681c073f9f91bf246: Generated new TSK 0
I20260809 23:19:02.393879 2650 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:19:02.430313 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39557
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:40989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:02.522230 2670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:02.522414 2670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:02.522439 2670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:02.523639 2670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:02.523679 2670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:02.523705 2670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:19:02.525202 2670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:40989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39557
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:02.525481 2670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:02.525708 2670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:02.530609 2675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:02.530653 2676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:02.530656 2678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:02.530694 2670 server_base.cc:1034] running on GCE node
I20260809 23:19:02.531025 2670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:02.531277 2670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:02.532441 2670 hybrid_clock.cc:648] HybridClock initialized: now 1786317542532428 us; error 28 us; skew 500 ppm
Aug 09 23:19:02 dist-test-slave-6nmv krb5kdc[2555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317542, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:02.535017 2670 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:19:02.535429 2670 webserver.cc:460] Webserver started at http://127.1.235.129:45645/ using document root <none> and password file <none>
I20260809 23:19:02.535738 2670 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:02.535816 2670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:02.535964 2670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:02.537214 2670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "d4976c28925445b19647a77df5078ee7"
format_stamp: "Formatted at 2026-08-09 23:19:02 on dist-test-slave-6nmv"
server_key: "e044ab91feebe771d4b0db53de43d353"
server_key_iv: "94c7f9a45134093b92a8f93143730079"
server_key_version: "encryptionkey@0"
I20260809 23:19:02.537568 2670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "d4976c28925445b19647a77df5078ee7"
format_stamp: "Formatted at 2026-08-09 23:19:02 on dist-test-slave-6nmv"
server_key: "e044ab91feebe771d4b0db53de43d353"
server_key_iv: "94c7f9a45134093b92a8f93143730079"
server_key_version: "encryptionkey@0"
I20260809 23:19:02.539135 2670 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:19:02.539840 2685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:02.540041 2670 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:02.540135 2670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "d4976c28925445b19647a77df5078ee7"
format_stamp: "Formatted at 2026-08-09 23:19:02 on dist-test-slave-6nmv"
server_key: "e044ab91feebe771d4b0db53de43d353"
server_key_iv: "94c7f9a45134093b92a8f93143730079"
server_key_version: "encryptionkey@0"
I20260809 23:19:02.540230 2670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:02.555891 2670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:02.557776 2670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:02.558007 2670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:02.558262 2670 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:02.558579 2670 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:02.558637 2670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:02.558671 2670 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:02.558714 2670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:02.564390 2670 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:42107
I20260809 23:19:02.564432 2818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:42107 every 8 connection(s)
I20260809 23:19:02.564761 2670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:19:02.565927 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 2670
I20260809 23:19:02.566004 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:19:02.566188 1966 external_mini_cluster.cc:1428] Setting key ca6e81bbd4c1cd5bfe9af179f469f979
Aug 09 23:19:02 dist-test-slave-6nmv krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317542, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:02.574986 2821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.565505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39557 (local address 127.1.235.129:40455)
0809 23:19:02.565704 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:02.565738 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:02.567118 (+ 1380us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:02.567364 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:02.567368 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:02.567631 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:02.567806 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:02.567809 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.568513 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.568514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:02.569313 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:02.569315 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.569880 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.569882 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:02.569996 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.570498 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:02.570505 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:02.571900 (+ 1395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:02.573662 (+ 1762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:02.573668 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:02.573669 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:02.573937 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:02.574149 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:02.574149 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:02.574149 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:02.574238 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:02.574522 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:02.574527 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:02.574646 (+ 119us) client_negotiation.cc:769] Sending connection context
0809 23:19:02.574718 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 23:19:02.574830 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":119,"threads_started":1}
I20260809 23:19:02.575006 2665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.565536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:40455 (local address 127.1.235.190:39557)
0809 23:19:02.565603 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:02.565605 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:02.565836 (+ 231us) server_negotiation.cc:407] Connection header received
0809 23:19:02.567220 (+ 1384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:02.567221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:02.567236 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:02.567290 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:02.567908 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.568417 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.569417 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.569742 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.569826 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.571992 (+ 2166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:02.571994 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:02.571994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:02.572003 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:02.573577 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:02.574014 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:02.574015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:02.574016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:02.574079 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:02.574310 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:02.574312 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:02.574312 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:02.574456 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:02.574526 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:02.574793 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 23:19:02.574885 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
I20260809 23:19:02.575489 2819 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39557
I20260809 23:19:02.575592 2819 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:02.575771 2819 heartbeater.cc:511] Master 127.1.235.190:39557 requested a full tablet report, sending...
I20260809 23:19:02.576196 2604 ts_manager.cc:194] Registered new tserver with Master: d4976c28925445b19647a77df5078ee7 (127.1.235.129:42107)
I20260809 23:19:02.576821 2604 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:40455
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:19:02.592562 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39557
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:40989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:02.677505 2824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:02.677732 2824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:02.677770 2824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:02.678957 2824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:02.679025 2824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:02.679072 2824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:19:02.680545 2824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:40989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39557
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:02.680802 2824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:02.681025 2824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:02.685892 2833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:02.685974 2830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:02.685942 2831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:02.686043 2824 server_base.cc:1034] running on GCE node
I20260809 23:19:02.686249 2824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:02.686497 2824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:02.687646 2824 hybrid_clock.cc:648] HybridClock initialized: now 1786317542687627 us; error 38 us; skew 500 ppm
Aug 09 23:19:02 dist-test-slave-6nmv krb5kdc[2555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317542, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:02.690122 2824 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:19:02.690459 2824 webserver.cc:460] Webserver started at http://127.1.235.130:33573/ using document root <none> and password file <none>
I20260809 23:19:02.690636 2824 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:02.690672 2824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:02.690752 2824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:02.691668 2824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "173b367a51b342b99c76c5ec7e3d8abc"
format_stamp: "Formatted at 2026-08-09 23:19:02 on dist-test-slave-6nmv"
server_key: "025f1541f6ac8548e301c833d38a008b"
server_key_iv: "6260d0fbbb26d01a380ac6d9751e1fba"
server_key_version: "encryptionkey@0"
I20260809 23:19:02.691978 2824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "173b367a51b342b99c76c5ec7e3d8abc"
format_stamp: "Formatted at 2026-08-09 23:19:02 on dist-test-slave-6nmv"
server_key: "025f1541f6ac8548e301c833d38a008b"
server_key_iv: "6260d0fbbb26d01a380ac6d9751e1fba"
server_key_version: "encryptionkey@0"
I20260809 23:19:02.693183 2824 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 23:19:02.693794 2841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:02.693976 2824 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:02.694044 2824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "173b367a51b342b99c76c5ec7e3d8abc"
format_stamp: "Formatted at 2026-08-09 23:19:02 on dist-test-slave-6nmv"
server_key: "025f1541f6ac8548e301c833d38a008b"
server_key_iv: "6260d0fbbb26d01a380ac6d9751e1fba"
server_key_version: "encryptionkey@0"
I20260809 23:19:02.694123 2824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:02.705320 2824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:02.707502 2824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:02.707657 2824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:02.707859 2824 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:02.708151 2824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:02.708207 2824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:02.708247 2824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:02.708272 2824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:02.714313 2824 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:41135
I20260809 23:19:02.714365 2968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:41135 every 8 connection(s)
I20260809 23:19:02.714665 2824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
Aug 09 23:19:02 dist-test-slave-6nmv krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317542, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:02.722051 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 2824
I20260809 23:19:02.722146 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:19:02.722321 1966 external_mini_cluster.cc:1428] Setting key 28753f6bdc86af62c92be219f9a02aa1
I20260809 23:19:02.724112 2665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.715383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:59445 (local address 127.1.235.190:39557)
0809 23:19:02.715455 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:02.715457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:02.715630 (+ 173us) server_negotiation.cc:407] Connection header received
0809 23:19:02.716534 (+ 904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:02.716535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:02.716544 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:02.716613 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:02.717189 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.717692 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.718754 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.719091 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.719185 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.721381 (+ 2196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:02.721383 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:02.721384 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:02.721391 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:02.722772 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:02.723186 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:02.723187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:02.723187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:02.723247 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:02.723494 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:02.723495 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:02.723495 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:02.723601 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:02.723666 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:02.723925 (+ 259us) server_negotiation.cc:299] Negotiation successful
0809 23:19:02.724028 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 23:19:02.724278 2971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.715343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39557 (local address 127.1.235.130:59445)
0809 23:19:02.715499 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:02.715539 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:02.716446 (+ 907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:02.716694 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:02.716697 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:02.716928 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:02.717110 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:02.717114 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.717763 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.717763 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:02.718651 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:02.718654 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.719206 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.719207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:02.719378 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.719960 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:02.719975 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:02.721287 (+ 1312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:02.722843 (+ 1556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:02.722849 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:02.722852 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:02.723110 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:02.723314 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:02.723314 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:02.723315 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:02.723417 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:02.723668 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:02.723675 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:02.723798 (+ 123us) client_negotiation.cc:769] Sending connection context
0809 23:19:02.723890 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 23:19:02.724056 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":86,"threads_started":1}
I20260809 23:19:02.724905 2969 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39557
I20260809 23:19:02.724993 2969 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:02.725158 2969 heartbeater.cc:511] Master 127.1.235.190:39557 requested a full tablet report, sending...
I20260809 23:19:02.725574 2604 ts_manager.cc:194] Registered new tserver with Master: 173b367a51b342b99c76c5ec7e3d8abc (127.1.235.130:41135)
I20260809 23:19:02.725994 2604 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:59445
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:19:02.746973 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39557
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:40989
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:02.825413 2974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:02.825582 2974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:02.825603 2974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:02.826630 2974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:02.826668 2974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:02.826692 2974 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:19:02.827939 2974 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:40989
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39557
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:02.828112 2974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:02.828274 2974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:02.833009 2980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:02.833003 2983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:02.833115 2981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:02.833199 2974 server_base.cc:1034] running on GCE node
I20260809 23:19:02.833446 2974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:02.833674 2974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:02.834823 2974 hybrid_clock.cc:648] HybridClock initialized: now 1786317542834822 us; error 33 us; skew 500 ppm
Aug 09 23:19:02 dist-test-slave-6nmv krb5kdc[2555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317542, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:02.837085 2974 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:19:02.837509 2974 webserver.cc:460] Webserver started at http://127.1.235.131:41871/ using document root <none> and password file <none>
I20260809 23:19:02.837744 2974 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:02.837809 2974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:02.837965 2974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:02.838949 2974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "5eb2683eeb2a466b818eb690b36d6b69"
format_stamp: "Formatted at 2026-08-09 23:19:02 on dist-test-slave-6nmv"
server_key: "b22f3b7378ed3167f1204bda2286270c"
server_key_iv: "78e6584597a743807551ef130f07e8fa"
server_key_version: "encryptionkey@0"
I20260809 23:19:02.839305 2974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "5eb2683eeb2a466b818eb690b36d6b69"
format_stamp: "Formatted at 2026-08-09 23:19:02 on dist-test-slave-6nmv"
server_key: "b22f3b7378ed3167f1204bda2286270c"
server_key_iv: "78e6584597a743807551ef130f07e8fa"
server_key_version: "encryptionkey@0"
I20260809 23:19:02.840591 2974 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 23:19:02.841267 2991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:02.841434 2974 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:19:02.841532 2974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "5eb2683eeb2a466b818eb690b36d6b69"
format_stamp: "Formatted at 2026-08-09 23:19:02 on dist-test-slave-6nmv"
server_key: "b22f3b7378ed3167f1204bda2286270c"
server_key_iv: "78e6584597a743807551ef130f07e8fa"
server_key_version: "encryptionkey@0"
I20260809 23:19:02.841609 2974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:02.853446 2974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:02.855122 2974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:02.855279 2974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:02.855474 2974 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:02.855783 2974 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:02.855834 2974 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:02.855871 2974 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:02.855896 2974 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:02.862107 2974 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:44177
I20260809 23:19:02.862159 3117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:44177 every 8 connection(s)
I20260809 23:19:02.862499 2974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
Aug 09 23:19:02 dist-test-slave-6nmv krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317542, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:02.870961 2665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.863251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:56017 (local address 127.1.235.190:39557)
0809 23:19:02.863320 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:02.863322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:02.863492 (+ 170us) server_negotiation.cc:407] Connection header received
0809 23:19:02.864350 (+ 858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:02.864351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:02.864360 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:02.864420 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:02.864926 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.865365 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.866329 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.866500 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.866568 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.868592 (+ 2024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:02.868594 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:02.868594 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:02.868601 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:02.869765 (+ 1164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:02.870196 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:02.870196 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:02.870197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:02.870251 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:02.870456 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:02.870456 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:02.870456 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:02.870556 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:02.870608 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:02.870820 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 23:19:02.870881 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 23:19:02.871100 3120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.863224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39557 (local address 127.1.235.131:56017)
0809 23:19:02.863376 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:02.863413 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:02.864265 (+ 852us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:02.864469 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:02.864472 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:02.864696 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:02.864861 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:02.864865 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.865437 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.865437 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:02.866262 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:02.866264 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.866584 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.866585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:02.866713 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.867144 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:02.867151 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:02.868495 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:02.869915 (+ 1420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:02.869921 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:02.869922 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:02.870125 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:02.870310 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:02.870311 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:02.870311 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:02.870402 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:02.870609 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:02.870613 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:02.870715 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 23:19:02.870790 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 23:19:02.870900 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":90,"threads_started":1}
I20260809 23:19:02.871637 3118 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39557
I20260809 23:19:02.871752 3118 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:02.871742 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 2974
I20260809 23:19:02.871857 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:19:02.871956 3118 heartbeater.cc:511] Master 127.1.235.190:39557 requested a full tablet report, sending...
I20260809 23:19:02.872062 1966 external_mini_cluster.cc:1428] Setting key 9805115952c71b4ddb0a61f008ac0d26
I20260809 23:19:02.872346 2604 ts_manager.cc:194] Registered new tserver with Master: 5eb2683eeb2a466b818eb690b36d6b69 (127.1.235.131:44177)
I20260809 23:19:02.872843 2604 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:56017
I20260809 23:19:02.872990 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:19:02.879954 2665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.875001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36616 (local address 127.1.235.190:39557)
0809 23:19:02.875036 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:02.875038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:02.875090 (+ 52us) server_negotiation.cc:407] Connection header received
0809 23:19:02.875138 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:02.875139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:02.875158 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:02.875202 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:02.875648 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.876056 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.876659 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.876812 (+ 153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.876856 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.877772 (+ 916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:02.877773 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:02.877774 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:02.877779 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:02.879042 (+ 1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:02.879339 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:02.879340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:02.879340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:02.879388 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:02.879546 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:02.879546 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:02.879546 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:02.879681 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:02.879753 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:02.879831 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 23:19:02.879886 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 23:19:02.882282 2604 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36616:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:19:02.883929 2604 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:19:02.890565 3132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.886869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:42107 (local address 127.0.0.1:53944)
0809 23:19:02.887175 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:02.887184 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:02.887225 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:02.887479 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:02.887479 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:02.887481 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:02.887515 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:02.887516 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.888666 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.888666 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:02.889394 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:02.889396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.890220 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.890221 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:02.890296 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.890315 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 23:19:02.890406 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 23:19:02.890454 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":43,"threads_started":1}
I20260809 23:19:02.890671 3129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.886670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:44177 (local address 127.0.0.1:33426)
0809 23:19:02.886817 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:02.886847 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:02.886901 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:02.887211 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:02.887214 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:02.887216 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:02.887274 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:02.887275 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.888217 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.888218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:02.889543 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:02.889546 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.890417 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.890418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:02.890482 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.890502 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 23:19:02.890556 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 23:19:02.890596 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":62,"threads_started":1}
I20260809 23:19:02.890829 3130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.886670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:41135 (local address 127.0.0.1:58440)
0809 23:19:02.886980 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:02.886988 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:02.887020 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:02.887310 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:02.887311 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:02.887313 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:02.887357 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:02.887359 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.888611 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.888612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:02.889694 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:02.889695 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.890583 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.890584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:02.890661 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.890666 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 23:19:02.890718 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 23:19:02.890765 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":25,"spinlock_wait_cycles":768,"thread_start_us":62,"threads_started":1}
I20260809 23:19:02.890857 3135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.887009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53944 (local address 127.1.235.129:42107)
0809 23:19:02.887327 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:02.887331 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:02.887339 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:19:02.887371 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:02.887372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:02.887385 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:02.887481 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:02.887568 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.888572 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.889484 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.890131 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.890207 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.890260 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:02.890747 (+ 487us) server_negotiation.cc:299] Negotiation successful
0809 23:19:02.890793 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":101,"threads_started":1}
I20260809 23:19:02.891001 3134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.886933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33426 (local address 127.1.235.131:44177)
0809 23:19:02.887058 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:02.887063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:02.887073 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:19:02.887108 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:02.887109 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:02.887124 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:02.887205 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:02.887333 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.888123 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.889637 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.890311 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.890386 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.890452 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:02.890585 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 23:19:02.890936 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":68,"threads_started":1}
I20260809 23:19:02.891055 3131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.886778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58440 (local address 127.1.235.130:41135)
0809 23:19:02.887105 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:02.887108 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:02.887116 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:19:02.887151 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:02.887152 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:02.887164 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:02.887228 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:02.887440 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.888496 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.889769 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.890406 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.890462 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.890527 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:02.890943 (+ 416us) server_negotiation.cc:299] Negotiation successful
0809 23:19:02.890980 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":73,"threads_started":1}
I20260809 23:19:02.891683 2745 tablet_service.cc:1467] Processing CreateTablet for tablet 7f536f84df6c4b7ba134e270d10e30d4 (DEFAULT_TABLE table=test-table [id=02cef653366b40b5aba0a64abcddfa5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:02.891731 3046 tablet_service.cc:1467] Processing CreateTablet for tablet 7f536f84df6c4b7ba134e270d10e30d4 (DEFAULT_TABLE table=test-table [id=02cef653366b40b5aba0a64abcddfa5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:02.891708 2896 tablet_service.cc:1467] Processing CreateTablet for tablet 7f536f84df6c4b7ba134e270d10e30d4 (DEFAULT_TABLE table=test-table [id=02cef653366b40b5aba0a64abcddfa5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:02.892055 2896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f536f84df6c4b7ba134e270d10e30d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:02.892050 2745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f536f84df6c4b7ba134e270d10e30d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:02.892048 3046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f536f84df6c4b7ba134e270d10e30d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:02.894780 3136 tablet_bootstrap.cc:492] T 7f536f84df6c4b7ba134e270d10e30d4 P 173b367a51b342b99c76c5ec7e3d8abc: Bootstrap starting.
I20260809 23:19:02.895494 3136 tablet_bootstrap.cc:654] T 7f536f84df6c4b7ba134e270d10e30d4 P 173b367a51b342b99c76c5ec7e3d8abc: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:02.895478 3137 tablet_bootstrap.cc:492] T 7f536f84df6c4b7ba134e270d10e30d4 P d4976c28925445b19647a77df5078ee7: Bootstrap starting.
I20260809 23:19:02.895783 3139 tablet_bootstrap.cc:492] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69: Bootstrap starting.
I20260809 23:19:02.896214 3137 tablet_bootstrap.cc:654] T 7f536f84df6c4b7ba134e270d10e30d4 P d4976c28925445b19647a77df5078ee7: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:02.896248 3136 log.cc:824] T 7f536f84df6c4b7ba134e270d10e30d4 P 173b367a51b342b99c76c5ec7e3d8abc: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:02.896404 3139 tablet_bootstrap.cc:654] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:02.896780 3137 log.cc:824] T 7f536f84df6c4b7ba134e270d10e30d4 P d4976c28925445b19647a77df5078ee7: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:02.896957 3139 log.cc:824] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:02.897568 3137 tablet_bootstrap.cc:492] T 7f536f84df6c4b7ba134e270d10e30d4 P d4976c28925445b19647a77df5078ee7: No bootstrap required, opened a new log
I20260809 23:19:02.897599 3136 tablet_bootstrap.cc:492] T 7f536f84df6c4b7ba134e270d10e30d4 P 173b367a51b342b99c76c5ec7e3d8abc: No bootstrap required, opened a new log
I20260809 23:19:02.897630 3137 ts_tablet_manager.cc:1397] T 7f536f84df6c4b7ba134e270d10e30d4 P d4976c28925445b19647a77df5078ee7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:19:02.897645 3136 ts_tablet_manager.cc:1397] T 7f536f84df6c4b7ba134e270d10e30d4 P 173b367a51b342b99c76c5ec7e3d8abc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260809 23:19:02.897794 3139 tablet_bootstrap.cc:492] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69: No bootstrap required, opened a new log
I20260809 23:19:02.897939 3139 ts_tablet_manager.cc:1397] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:19:02.899324 3139 raft_consensus.cc:348] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173b367a51b342b99c76c5ec7e3d8abc" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41135 } } peers { permanent_uuid: "5eb2683eeb2a466b818eb690b36d6b69" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44177 } } peers { permanent_uuid: "d4976c28925445b19647a77df5078ee7" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 42107 } }
I20260809 23:19:02.899442 3139 raft_consensus.cc:374] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:02.899463 3139 raft_consensus.cc:729] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eb2683eeb2a466b818eb690b36d6b69, State: Initialized, Role: FOLLOWER
I20260809 23:19:02.899587 3139 consensus_queue.cc:260] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173b367a51b342b99c76c5ec7e3d8abc" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41135 } } peers { permanent_uuid: "5eb2683eeb2a466b818eb690b36d6b69" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44177 } } peers { permanent_uuid: "d4976c28925445b19647a77df5078ee7" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 42107 } }
I20260809 23:19:02.899634 3137 raft_consensus.cc:348] T 7f536f84df6c4b7ba134e270d10e30d4 P d4976c28925445b19647a77df5078ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173b367a51b342b99c76c5ec7e3d8abc" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41135 } } peers { permanent_uuid: "5eb2683eeb2a466b818eb690b36d6b69" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44177 } } peers { permanent_uuid: "d4976c28925445b19647a77df5078ee7" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 42107 } }
I20260809 23:19:02.899648 3136 raft_consensus.cc:348] T 7f536f84df6c4b7ba134e270d10e30d4 P 173b367a51b342b99c76c5ec7e3d8abc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173b367a51b342b99c76c5ec7e3d8abc" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41135 } } peers { permanent_uuid: "5eb2683eeb2a466b818eb690b36d6b69" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44177 } } peers { permanent_uuid: "d4976c28925445b19647a77df5078ee7" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 42107 } }
I20260809 23:19:02.899811 3137 raft_consensus.cc:374] T 7f536f84df6c4b7ba134e270d10e30d4 P d4976c28925445b19647a77df5078ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:02.899811 3136 raft_consensus.cc:374] T 7f536f84df6c4b7ba134e270d10e30d4 P 173b367a51b342b99c76c5ec7e3d8abc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:02.899845 3137 raft_consensus.cc:729] T 7f536f84df6c4b7ba134e270d10e30d4 P d4976c28925445b19647a77df5078ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4976c28925445b19647a77df5078ee7, State: Initialized, Role: FOLLOWER
I20260809 23:19:02.899845 3136 raft_consensus.cc:729] T 7f536f84df6c4b7ba134e270d10e30d4 P 173b367a51b342b99c76c5ec7e3d8abc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 173b367a51b342b99c76c5ec7e3d8abc, State: Initialized, Role: FOLLOWER
I20260809 23:19:02.899945 3118 heartbeater.cc:503] Master 127.1.235.190:39557 was elected leader, sending a full tablet report...
I20260809 23:19:02.899974 3139 ts_tablet_manager.cc:1428] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 23:19:02.899976 3137 consensus_queue.cc:260] T 7f536f84df6c4b7ba134e270d10e30d4 P d4976c28925445b19647a77df5078ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173b367a51b342b99c76c5ec7e3d8abc" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41135 } } peers { permanent_uuid: "5eb2683eeb2a466b818eb690b36d6b69" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44177 } } peers { permanent_uuid: "d4976c28925445b19647a77df5078ee7" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 42107 } }
I20260809 23:19:02.900208 3136 consensus_queue.cc:260] T 7f536f84df6c4b7ba134e270d10e30d4 P 173b367a51b342b99c76c5ec7e3d8abc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173b367a51b342b99c76c5ec7e3d8abc" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41135 } } peers { permanent_uuid: "5eb2683eeb2a466b818eb690b36d6b69" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44177 } } peers { permanent_uuid: "d4976c28925445b19647a77df5078ee7" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 42107 } }
I20260809 23:19:02.900242 3137 ts_tablet_manager.cc:1428] T 7f536f84df6c4b7ba134e270d10e30d4 P d4976c28925445b19647a77df5078ee7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:19:02.900239 2819 heartbeater.cc:503] Master 127.1.235.190:39557 was elected leader, sending a full tablet report...
I20260809 23:19:02.900496 2969 heartbeater.cc:503] Master 127.1.235.190:39557 was elected leader, sending a full tablet report...
I20260809 23:19:02.900722 3136 ts_tablet_manager.cc:1428] T 7f536f84df6c4b7ba134e270d10e30d4 P 173b367a51b342b99c76c5ec7e3d8abc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260809 23:19:02.965238 2970 tablet.cc:2369] T 7f536f84df6c4b7ba134e270d10e30d4 P 173b367a51b342b99c76c5ec7e3d8abc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:19:02.995191 3146 raft_consensus.cc:482] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:19:02.995301 3146 raft_consensus.cc:504] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173b367a51b342b99c76c5ec7e3d8abc" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41135 } } peers { permanent_uuid: "5eb2683eeb2a466b818eb690b36d6b69" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44177 } } peers { permanent_uuid: "d4976c28925445b19647a77df5078ee7" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 42107 } }
I20260809 23:19:02.995970 3146 leader_election.cc:288] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 173b367a51b342b99c76c5ec7e3d8abc (127.1.235.130:41135), d4976c28925445b19647a77df5078ee7 (127.1.235.129:42107)
I20260809 23:19:02.998847 3131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.996222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:57211 (local address 127.1.235.130:41135)
0809 23:19:02.996260 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:02.996262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:02.996272 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:19:02.996301 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:02.996302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:02.996314 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:02.996388 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:02.996547 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.996993 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.998094 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.998498 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.998585 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.998594 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:02.998744 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 23:19:02.998778 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 23:19:02.998847 3120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.996127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:41135 (local address 127.1.235.131:57211)
0809 23:19:02.996176 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:02.996188 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:02.996246 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:02.996403 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:02.996404 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:02.996406 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:02.996478 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:02.996480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.997076 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.997077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:02.998005 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:02.998008 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.998584 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.998585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:02.998668 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.998671 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:19:02.998738 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 23:19:02.998778 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 23:19:02.999122 3149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.996283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:42107 (local address 127.1.235.131:51385)
0809 23:19:02.996476 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:02.996482 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:02.996555 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:02.996693 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:02.996694 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:02.996695 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:02.996770 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:02.996772 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.997404 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.997405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:02.998266 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:02.998268 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.998814 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.998815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:02.998889 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.998892 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:19:02.999001 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 23:19:02.999049 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":128,"threads_started":1}
I20260809 23:19:02.999137 3135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:02.996365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:51385 (local address 127.1.235.129:42107)
0809 23:19:02.996410 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:02.996412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:02.996544 (+ 132us) server_negotiation.cc:407] Connection header received
0809 23:19:02.996630 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:02.996631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:02.996639 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:02.996690 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:02.996838 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.997310 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.998354 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:02.998729 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:02.998814 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:02.998822 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:02.999020 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 23:19:02.999064 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 23:19:02.999249 2919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f536f84df6c4b7ba134e270d10e30d4" candidate_uuid: "5eb2683eeb2a466b818eb690b36d6b69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173b367a51b342b99c76c5ec7e3d8abc" is_pre_election: true
I20260809 23:19:02.999415 2919 raft_consensus.cc:2454] T 7f536f84df6c4b7ba134e270d10e30d4 P 173b367a51b342b99c76c5ec7e3d8abc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb2683eeb2a466b818eb690b36d6b69 in term 0.
I20260809 23:19:02.999706 2995 leader_election.cc:302] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173b367a51b342b99c76c5ec7e3d8abc, 5eb2683eeb2a466b818eb690b36d6b69; no voters:
I20260809 23:19:02.999794 2770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f536f84df6c4b7ba134e270d10e30d4" candidate_uuid: "5eb2683eeb2a466b818eb690b36d6b69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4976c28925445b19647a77df5078ee7" is_pre_election: true
I20260809 23:19:02.999823 3146 raft_consensus.cc:2781] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:19:02.999878 3146 raft_consensus.cc:482] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:19:02.999922 3146 raft_consensus.cc:3037] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:02.999933 2770 raft_consensus.cc:2454] T 7f536f84df6c4b7ba134e270d10e30d4 P d4976c28925445b19647a77df5078ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5eb2683eeb2a466b818eb690b36d6b69 in term 0.
I20260809 23:19:03.000731 3146 raft_consensus.cc:504] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173b367a51b342b99c76c5ec7e3d8abc" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41135 } } peers { permanent_uuid: "5eb2683eeb2a466b818eb690b36d6b69" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44177 } } peers { permanent_uuid: "d4976c28925445b19647a77df5078ee7" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 42107 } }
I20260809 23:19:03.000855 3146 leader_election.cc:288] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 [CANDIDATE]: Term 1 election: Requested vote from peers 173b367a51b342b99c76c5ec7e3d8abc (127.1.235.130:41135), d4976c28925445b19647a77df5078ee7 (127.1.235.129:42107)
I20260809 23:19:03.000993 2919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f536f84df6c4b7ba134e270d10e30d4" candidate_uuid: "5eb2683eeb2a466b818eb690b36d6b69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "173b367a51b342b99c76c5ec7e3d8abc"
I20260809 23:19:03.001070 2770 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f536f84df6c4b7ba134e270d10e30d4" candidate_uuid: "5eb2683eeb2a466b818eb690b36d6b69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4976c28925445b19647a77df5078ee7"
I20260809 23:19:03.001091 2919 raft_consensus.cc:3037] T 7f536f84df6c4b7ba134e270d10e30d4 P 173b367a51b342b99c76c5ec7e3d8abc [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:03.001150 2770 raft_consensus.cc:3037] T 7f536f84df6c4b7ba134e270d10e30d4 P d4976c28925445b19647a77df5078ee7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:03.002084 2770 raft_consensus.cc:2454] T 7f536f84df6c4b7ba134e270d10e30d4 P d4976c28925445b19647a77df5078ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb2683eeb2a466b818eb690b36d6b69 in term 1.
I20260809 23:19:03.002084 2919 raft_consensus.cc:2454] T 7f536f84df6c4b7ba134e270d10e30d4 P 173b367a51b342b99c76c5ec7e3d8abc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5eb2683eeb2a466b818eb690b36d6b69 in term 1.
I20260809 23:19:03.002252 2995 leader_election.cc:302] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 173b367a51b342b99c76c5ec7e3d8abc, 5eb2683eeb2a466b818eb690b36d6b69; no voters:
I20260809 23:19:03.002334 3146 raft_consensus.cc:2781] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:03.002491 3146 raft_consensus.cc:686] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 [term 1 LEADER]: Becoming Leader. State: Replica: 5eb2683eeb2a466b818eb690b36d6b69, State: Running, Role: LEADER
I20260809 23:19:03.002592 3146 consensus_queue.cc:237] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173b367a51b342b99c76c5ec7e3d8abc" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41135 } } peers { permanent_uuid: "5eb2683eeb2a466b818eb690b36d6b69" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44177 } } peers { permanent_uuid: "d4976c28925445b19647a77df5078ee7" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 42107 } }
I20260809 23:19:03.003489 2604 catalog_manager.cc:5495] T 7f536f84df6c4b7ba134e270d10e30d4 P 5eb2683eeb2a466b818eb690b36d6b69 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5eb2683eeb2a466b818eb690b36d6b69 (127.1.235.131). New cstate: current_term: 1 leader_uuid: "5eb2683eeb2a466b818eb690b36d6b69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "173b367a51b342b99c76c5ec7e3d8abc" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eb2683eeb2a466b818eb690b36d6b69" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4976c28925445b19647a77df5078ee7" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 42107 } health_report { overall_health: UNKNOWN } } }
Aug 09 23:19:03 dist-test-slave-6nmv krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.129@KRBTEST.COM
I20260809 23:19:03.040807 3135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:03.033384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53954 (local address 127.1.235.129:42107)
0809 23:19:03.033482 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:03.033485 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:03.033683 (+ 198us) server_negotiation.cc:407] Connection header received
0809 23:19:03.033776 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:03.033777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:03.033787 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:03.033858 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:03.034397 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:03.034830 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:03.035497 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:03.035692 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:03.035764 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:03.038069 (+ 2305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:03.038079 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:03.038079 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:03.038086 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:03.039643 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:03.039996 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:03.039999 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:03.039999 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:03.040062 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:03.040255 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:03.040256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:03.040256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:03.040391 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:03.040583 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:03.040622 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 23:19:03.040700 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
Aug 09 23:19:03 dist-test-slave-6nmv krb5kdc[2555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317543, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 23:19:03 dist-test-slave-6nmv krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317543, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.235.129@KRBTEST.COM
I20260809 23:19:03.063446 3135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:03.056944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53960 (local address 127.1.235.129:42107)
0809 23:19:03.057001 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:03.057002 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:03.057095 (+ 93us) server_negotiation.cc:407] Connection header received
0809 23:19:03.057175 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:03.057176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:03.057185 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:03.057249 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:03.057740 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:03.058191 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:03.058912 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:03.059111 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:03.059188 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:03.061137 (+ 1949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:03.061138 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:03.061139 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:03.061146 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:03.062321 (+ 1175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:03.062671 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:03.062674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:03.062674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:03.062724 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:03.062906 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:03.062907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:03.062907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:03.062996 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:03.063112 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:03.063270 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 23:19:03.063354 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260809 23:19:03.065467 2820 tablet.cc:2369] T 7f536f84df6c4b7ba134e270d10e30d4 P d4976c28925445b19647a77df5078ee7: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 23:19:03 dist-test-slave-6nmv krb5kdc[2555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 23:19:03 dist-test-slave-6nmv krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.129@KRBTEST.COM
I20260809 23:19:03.083742 3135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:03.077705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53972 (local address 127.1.235.129:42107)
0809 23:19:03.077779 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:03.077781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:03.077866 (+ 85us) server_negotiation.cc:407] Connection header received
0809 23:19:03.077958 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:03.077959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:03.077967 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:03.078028 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:03.078520 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:03.078947 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:03.079594 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:03.079767 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:03.079812 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:03.081793 (+ 1981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:03.081794 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:03.081794 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:03.081800 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:03.082928 (+ 1128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:03.083213 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:03.083213 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:03.083214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:03.083258 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:03.083413 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:03.083413 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:03.083414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:03.083481 (+ 67us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:03.083548 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:03.083637 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 23:19:03.083685 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260809 23:19:03.084357 2717 tablet_service.cc:2908] Rejecting scan request for tablet 7f536f84df6c4b7ba134e270d10e30d4: Uninitialized: clean time has not yet been initialized
I20260809 23:19:03.085184 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 2670
I20260809 23:19:03.090847 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 2824
I20260809 23:19:03.096647 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 2974
I20260809 23:19:03.102527 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 2570
2026-08-09T23:19:03Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2038 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:19:03 dist-test-slave-6nmv krb5kdc[3165](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:19:03 dist-test-slave-6nmv krb5kdc[3165](info): set up 2 sockets
Aug 09 23:19:03 dist-test-slave-6nmv krb5kdc[3165](info): commencing operation
krb5kdc: starting...
W20260809 23:19:04.129087 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.005s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:19:04 dist-test-slave-6nmv krb5kdc[3165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:19:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:19:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:19:04.239955 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:37487
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:45249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:37487
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:04.316601 3179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:04.316778 3179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:04.316800 3179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:04.317929 3179 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:04.317968 3179 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 23:19:04.317981 3179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:04.317993 3179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:04.318039 3179 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:04.318055 3179 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:19:04.319495 3179 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:45249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:37487
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:37487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:04.319762 3179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:04.319996 3179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:04.324429 3184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:04.324435 3187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:04.324461 3185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:04.324745 3179 server_base.cc:1034] running on GCE node
I20260809 23:19:04.324978 3179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:04.325253 3179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:04.326418 3179 hybrid_clock.cc:648] HybridClock initialized: now 1786317544326405 us; error 43 us; skew 500 ppm
Aug 09 23:19:04 dist-test-slave-6nmv krb5kdc[3165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317544, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:04.334874 3179 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:19:04.335315 3179 webserver.cc:460] Webserver started at http://127.1.235.190:43951/ using document root <none> and password file <none>
I20260809 23:19:04.335543 3179 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:04.335609 3179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:04.335763 3179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:04.336671 3179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "38881f42134644f3857440049d7799e6"
format_stamp: "Formatted at 2026-08-09 23:19:04 on dist-test-slave-6nmv"
server_key: "4be22e4b9aa8420aa520d9ed38592ed8"
server_key_iv: "75a9bc61e489474deff09b74a3b8d3f8"
server_key_version: "encryptionkey@0"
I20260809 23:19:04.337020 3179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "38881f42134644f3857440049d7799e6"
format_stamp: "Formatted at 2026-08-09 23:19:04 on dist-test-slave-6nmv"
server_key: "4be22e4b9aa8420aa520d9ed38592ed8"
server_key_iv: "75a9bc61e489474deff09b74a3b8d3f8"
server_key_version: "encryptionkey@0"
I20260809 23:19:04.338353 3179 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:19:04.339094 3194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:04.339260 3179 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:19:04.339356 3179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "38881f42134644f3857440049d7799e6"
format_stamp: "Formatted at 2026-08-09 23:19:04 on dist-test-slave-6nmv"
server_key: "4be22e4b9aa8420aa520d9ed38592ed8"
server_key_iv: "75a9bc61e489474deff09b74a3b8d3f8"
server_key_version: "encryptionkey@0"
I20260809 23:19:04.339433 3179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:04.352968 3179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:04.354897 3179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:04.355041 3179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:04.359578 3179 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:37487
I20260809 23:19:04.359656 3261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:37487 every 8 connection(s)
I20260809 23:19:04.359962 3179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:19:04.360597 3262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:04.362654 3262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6: Bootstrap starting.
I20260809 23:19:04.363209 3262 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:04.363524 3262 log.cc:824] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:04.364084 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 3179
I20260809 23:19:04.364161 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:19:04.364257 3262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6: No bootstrap required, opened a new log
I20260809 23:19:04.364344 1966 external_mini_cluster.cc:1428] Setting key 61c80461b08268208f0af3c7127304f2
I20260809 23:19:04.366660 3262 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38881f42134644f3857440049d7799e6" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37487 } }
I20260809 23:19:04.366811 3262 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:04.366858 3262 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38881f42134644f3857440049d7799e6, State: Initialized, Role: FOLLOWER
I20260809 23:19:04.367022 3262 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38881f42134644f3857440049d7799e6" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37487 } }
I20260809 23:19:04.367110 3262 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:19:04.367151 3262 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:19:04.367195 3262 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:04.367741 3262 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38881f42134644f3857440049d7799e6" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37487 } }
I20260809 23:19:04.367869 3262 leader_election.cc:302] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38881f42134644f3857440049d7799e6; no voters:
I20260809 23:19:04.368083 3262 leader_election.cc:288] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:19:04.368112 3268 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:04.368220 3268 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [term 1 LEADER]: Becoming Leader. State: Replica: 38881f42134644f3857440049d7799e6, State: Running, Role: LEADER
I20260809 23:19:04.368337 3262 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:04.368355 3268 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38881f42134644f3857440049d7799e6" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37487 } }
I20260809 23:19:04.368690 3268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38881f42134644f3857440049d7799e6. Latest consensus state: current_term: 1 leader_uuid: "38881f42134644f3857440049d7799e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38881f42134644f3857440049d7799e6" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37487 } } }
I20260809 23:19:04.368786 3268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:04.368701 3269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38881f42134644f3857440049d7799e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38881f42134644f3857440049d7799e6" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37487 } } }
I20260809 23:19:04.368939 3269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:04.369002 3274 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:19:04.369536 3274 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:19:04.371171 3274 catalog_manager.cc:1347] Generated new cluster ID: f4edf2a923924344ab4296502def83c9
I20260809 23:19:04.371224 3274 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 23:19:04 dist-test-slave-6nmv krb5kdc[3165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317544, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:04.377570 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.364861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58664 (local address 127.1.235.190:37487)
0809 23:19:04.365047 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:04.365055 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:04.365089 (+ 34us) server_negotiation.cc:407] Connection header received
0809 23:19:04.366652 (+ 1563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:04.366657 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:04.366705 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:04.366861 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:04.367608 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.368954 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.370057 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.370729 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.371117 (+ 388us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.373495 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:04.373499 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:04.373499 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:04.373510 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:04.375992 (+ 2482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:04.376350 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:04.376352 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:04.376353 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:04.376471 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:04.376668 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:04.376669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:04.376669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:04.376990 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:04.377154 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:04.377233 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 23:19:04.377385 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":73,"threads_started":1}
I20260809 23:19:04.410347 3274 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:19:04.411087 3274 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:19:04.414402 3274 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6: Generated new TSK 0
I20260809 23:19:04.414589 3274 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:19:04.440616 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:37487
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:45249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:04.520989 3293 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:04.521190 3293 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:04.521214 3293 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:04.522394 3293 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:04.522435 3293 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:04.522455 3293 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 23:19:04.522473 3293 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:19:04.523931 3293 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:45249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.235.190:37487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3293
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:04.524173 3293 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:04.524397 3293 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:04.529493 3299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:04.529479 3302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:04.529517 3293 server_base.cc:1034] running on GCE node
W20260809 23:19:04.529482 3298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:04.529937 3293 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:04.530179 3293 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:04.531373 3293 hybrid_clock.cc:648] HybridClock initialized: now 1786317544531351 us; error 31 us; skew 500 ppm
Aug 09 23:19:04 dist-test-slave-6nmv krb5kdc[3165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317544, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:04.533856 3293 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:19:04.534274 3293 webserver.cc:460] Webserver started at http://127.1.235.129:46433/ using document root <none> and password file <none>
I20260809 23:19:04.534520 3293 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:04.534588 3293 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:04.534732 3293 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:04.535799 3293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "2d277cf79c964eb189cfca9a60a6ab28"
format_stamp: "Formatted at 2026-08-09 23:19:04 on dist-test-slave-6nmv"
server_key: "41c36bda593ba818660ce9152f3044fb"
server_key_iv: "85b3b0d70b03b6c0f8bdce2048c510cf"
server_key_version: "encryptionkey@0"
I20260809 23:19:04.536161 3293 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "2d277cf79c964eb189cfca9a60a6ab28"
format_stamp: "Formatted at 2026-08-09 23:19:04 on dist-test-slave-6nmv"
server_key: "41c36bda593ba818660ce9152f3044fb"
server_key_iv: "85b3b0d70b03b6c0f8bdce2048c510cf"
server_key_version: "encryptionkey@0"
I20260809 23:19:04.537431 3293 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 23:19:04.538213 3310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:04.538378 3293 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:04.538477 3293 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "2d277cf79c964eb189cfca9a60a6ab28"
format_stamp: "Formatted at 2026-08-09 23:19:04 on dist-test-slave-6nmv"
server_key: "41c36bda593ba818660ce9152f3044fb"
server_key_iv: "85b3b0d70b03b6c0f8bdce2048c510cf"
server_key_version: "encryptionkey@0"
I20260809 23:19:04.538574 3293 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:04.549727 3293 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:04.551514 3293 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:04.551703 3293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:04.552201 3293 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:04.552261 3293 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:04.552295 3293 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:04.552325 3293 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:04.559301 3293 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:45173
I20260809 23:19:04.559356 3439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:45173 every 8 connection(s)
Aug 09 23:19:04 dist-test-slave-6nmv krb5kdc[3165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317544, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:04.559731 3293 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:19:04.562772 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.552875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:58453 (local address 127.1.235.190:37487)
0809 23:19:04.552924 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:04.552926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:04.553189 (+ 263us) server_negotiation.cc:407] Connection header received
0809 23:19:04.553707 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:04.553709 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:04.553724 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:04.553778 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:04.554733 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.555561 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.557087 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.557434 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.557596 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.560185 (+ 2589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:04.560187 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:04.560187 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:04.560195 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:04.561364 (+ 1169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:04.561765 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:04.561766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:04.561767 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:04.561872 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:04.562122 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:04.562123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:04.562123 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:04.562242 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:04.562319 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:04.562588 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 23:19:04.562683 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 23:19:04.562939 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.552878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:37487 (local address 127.1.235.129:58453)
0809 23:19:04.553062 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:04.553095 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:04.553604 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:04.553941 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:04.553945 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:04.554329 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:04.554621 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.554628 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.555655 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.555656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.556981 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.556985 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.557595 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.557596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.557691 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.558238 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:04.558249 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:04.560099 (+ 1850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:04.561449 (+ 1350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:04.561456 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:04.561459 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:04.561683 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:04.561926 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:04.561927 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:04.561927 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:04.562043 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:04.562310 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:04.562317 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:04.562451 (+ 134us) client_negotiation.cc:769] Sending connection context
0809 23:19:04.562568 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 23:19:04.562720 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":90,"threads_started":1}
I20260809 23:19:04.563381 3440 heartbeater.cc:347] Connected to a master server at 127.1.235.190:37487
I20260809 23:19:04.563467 3440 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:04.563649 3440 heartbeater.cc:511] Master 127.1.235.190:37487 requested a full tablet report, sending...
I20260809 23:19:04.564221 3210 ts_manager.cc:194] Registered new tserver with Master: 2d277cf79c964eb189cfca9a60a6ab28 (127.1.235.129:45173)
I20260809 23:19:04.565109 3210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:58453
I20260809 23:19:04.565657 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 3293
I20260809 23:19:04.565771 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:19:04.565989 1966 external_mini_cluster.cc:1428] Setting key 6be941f0731182324c26c33f051a6ed1
I20260809 23:19:04.571023 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.564529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:38161 (local address 127.1.235.190:37487)
0809 23:19:04.564588 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:04.564590 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:04.564648 (+ 58us) server_negotiation.cc:407] Connection header received
0809 23:19:04.564708 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:04.564709 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:04.564718 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:04.564771 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:04.565051 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.565710 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.566608 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.566887 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.566966 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.568210 (+ 1244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:04.568212 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:04.568212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:04.568221 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:04.569869 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:04.570292 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:04.570293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:04.570293 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:04.570350 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:04.570576 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:04.570576 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:04.570576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:04.570671 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:04.570722 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:04.570885 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 23:19:04.570947 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 23:19:04.571147 3446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.564459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:37487 (local address 127.1.235.129:38161)
0809 23:19:04.564589 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:04.564600 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:04.564656 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:04.564774 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:04.564775 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:04.564936 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:04.564981 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.564982 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.565843 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.565844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.566502 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.566505 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.567077 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.567078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.567170 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.567744 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:04.567763 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:04.568122 (+ 359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:04.569944 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:04.569945 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:04.569945 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:04.570210 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:04.570441 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:04.570442 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:04.570442 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:04.570515 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:04.570732 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:04.570733 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:04.570783 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 23:19:04.570866 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 23:19:04.570994 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":80,"threads_started":1}
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:19:04.593170 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:37487
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:45249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:04.674938 3449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:04.675163 3449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:04.675199 3449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:04.676285 3449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:04.676349 3449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:04.676381 3449 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 23:19:04.676421 3449 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:19:04.677798 3449 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:45249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.235.190:37487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:04.678090 3449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:04.678318 3449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:04.683631 3456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:04.683658 3455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:04.683698 3449 server_base.cc:1034] running on GCE node
W20260809 23:19:04.683640 3458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:04.684038 3449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:04.684266 3449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:04.685431 3449 hybrid_clock.cc:648] HybridClock initialized: now 1786317544685419 us; error 24 us; skew 500 ppm
Aug 09 23:19:04 dist-test-slave-6nmv krb5kdc[3165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317544, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:04.687887 3449 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:19:04.688335 3449 webserver.cc:460] Webserver started at http://127.1.235.130:42839/ using document root <none> and password file <none>
I20260809 23:19:04.688586 3449 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:04.688656 3449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:04.688802 3449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:04.689781 3449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "642e5ca59a38463caa18a04ff2daf7f5"
format_stamp: "Formatted at 2026-08-09 23:19:04 on dist-test-slave-6nmv"
server_key: "e54c03e3ce40358ba2f1248674f043cf"
server_key_iv: "042057b3c90d2426117f9dcb6575f71f"
server_key_version: "encryptionkey@0"
I20260809 23:19:04.690176 3449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "642e5ca59a38463caa18a04ff2daf7f5"
format_stamp: "Formatted at 2026-08-09 23:19:04 on dist-test-slave-6nmv"
server_key: "e54c03e3ce40358ba2f1248674f043cf"
server_key_iv: "042057b3c90d2426117f9dcb6575f71f"
server_key_version: "encryptionkey@0"
I20260809 23:19:04.691493 3449 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:04.692221 3466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:04.692507 3449 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:04.692612 3449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "642e5ca59a38463caa18a04ff2daf7f5"
format_stamp: "Formatted at 2026-08-09 23:19:04 on dist-test-slave-6nmv"
server_key: "e54c03e3ce40358ba2f1248674f043cf"
server_key_iv: "042057b3c90d2426117f9dcb6575f71f"
server_key_version: "encryptionkey@0"
I20260809 23:19:04.692682 3449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:04.712634 3449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:04.714613 3449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:04.714779 3449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:04.715310 3449 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:04.715366 3449 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:04.715425 3449 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:04.715453 3449 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:04.722550 3449 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:38871
I20260809 23:19:04.722611 3592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:38871 every 8 connection(s)
Aug 09 23:19:04 dist-test-slave-6nmv krb5kdc[3165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317544, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:04.722918 3449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:19:04.726203 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.715710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:34625 (local address 127.1.235.190:37487)
0809 23:19:04.715789 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:04.715792 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:04.716037 (+ 245us) server_negotiation.cc:407] Connection header received
0809 23:19:04.716722 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:04.716723 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:04.716732 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:04.716814 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:04.717696 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.718312 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.719959 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.720173 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.720220 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.723363 (+ 3143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:04.723364 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:04.723364 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:04.723371 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:04.724872 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:04.725258 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:04.725259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:04.725260 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:04.725316 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:04.725572 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:04.725573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:04.725574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:04.725687 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:04.725758 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:04.726076 (+ 318us) server_negotiation.cc:299] Negotiation successful
0809 23:19:04.726141 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 23:19:04.726446 3476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.715697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:37487 (local address 127.1.235.130:34625)
0809 23:19:04.715898 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:04.715946 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:04.716593 (+ 647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:04.716891 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:04.716895 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:04.717321 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:04.717600 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.717605 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.718376 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.718377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.719870 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.719873 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.720249 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.720250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.720402 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.721554 (+ 1152us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:04.721565 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:04.723275 (+ 1710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:04.724961 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:04.724967 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:04.724969 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:04.725184 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:04.725389 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:04.725390 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:04.725391 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:04.725501 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:04.725749 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:04.725756 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:04.725927 (+ 171us) client_negotiation.cc:769] Sending connection context
0809 23:19:04.726044 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 23:19:04.726198 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":106,"threads_started":1}
I20260809 23:19:04.726976 3593 heartbeater.cc:347] Connected to a master server at 127.1.235.190:37487
I20260809 23:19:04.727066 3593 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:04.727224 3593 heartbeater.cc:511] Master 127.1.235.190:37487 requested a full tablet report, sending...
I20260809 23:19:04.727576 3211 ts_manager.cc:194] Registered new tserver with Master: 642e5ca59a38463caa18a04ff2daf7f5 (127.1.235.130:38871)
I20260809 23:19:04.727939 3211 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:34625
I20260809 23:19:04.727999 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 3449
I20260809 23:19:04.728092 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:19:04.728299 1966 external_mini_cluster.cc:1428] Setting key cf6629c9e46a1fa188db0eac5eda69e5
I20260809 23:19:04.733996 3599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.727914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:37487 (local address 127.1.235.130:60141)
0809 23:19:04.728040 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:04.728050 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:04.728146 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:04.728274 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:04.728275 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:04.728510 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:04.728596 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.728599 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.729434 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.729435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.730009 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.730011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.730493 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.730493 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.730569 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.730937 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:04.730943 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:04.731295 (+ 352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:04.732879 (+ 1584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:04.732880 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:04.732880 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:04.733107 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:04.733307 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:04.733308 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:04.733308 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:04.733375 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:04.733687 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:04.733687 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:04.733743 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 23:19:04.733858 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 23:19:04.733942 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":64,"threads_started":1}
I20260809 23:19:04.734095 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.727971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:60141 (local address 127.1.235.190:37487)
0809 23:19:04.728005 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:04.728006 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:04.728104 (+ 98us) server_negotiation.cc:407] Connection header received
0809 23:19:04.728209 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:04.728210 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:04.728221 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:04.728269 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:04.728688 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.729336 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.730086 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.730400 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.730469 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.731373 (+ 904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:04.731374 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:04.731375 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:04.731380 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:04.732778 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:04.733183 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:04.733184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:04.733184 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:04.733236 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:04.733454 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:04.733455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:04.733455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:04.733586 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:04.733679 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:04.733869 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 23:19:04.733967 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:19:04.752480 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:37487
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:45249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:04.831564 3602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:04.831811 3602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:04.831849 3602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:04.832995 3602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:04.833058 3602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:04.833094 3602 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 23:19:04.833150 3602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:19:04.834583 3602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:45249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.235.190:37487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:04.834838 3602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:04.835067 3602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:04.840010 3609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:04.839995 3611 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:04.839984 3602 server_base.cc:1034] running on GCE node
W20260809 23:19:04.840037 3613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:04.840389 3602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:04.840627 3602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:04.841838 3602 hybrid_clock.cc:648] HybridClock initialized: now 1786317544841821 us; error 52 us; skew 500 ppm
Aug 09 23:19:04 dist-test-slave-6nmv krb5kdc[3165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317544, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:04.844424 3602 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:19:04.844842 3602 webserver.cc:460] Webserver started at http://127.1.235.131:39933/ using document root <none> and password file <none>
I20260809 23:19:04.845014 3602 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:04.845053 3602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:04.845139 3602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:04.846128 3602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "67d3c6bdaf4b4c588867ac2f97d3feda"
format_stamp: "Formatted at 2026-08-09 23:19:04 on dist-test-slave-6nmv"
server_key: "a8a86def035354e891ef67fbe06658af"
server_key_iv: "46e76f74fbb0a0a415fdf5af2c3e702f"
server_key_version: "encryptionkey@0"
I20260809 23:19:04.846503 3602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "67d3c6bdaf4b4c588867ac2f97d3feda"
format_stamp: "Formatted at 2026-08-09 23:19:04 on dist-test-slave-6nmv"
server_key: "a8a86def035354e891ef67fbe06658af"
server_key_iv: "46e76f74fbb0a0a415fdf5af2c3e702f"
server_key_version: "encryptionkey@0"
I20260809 23:19:04.847734 3602 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:19:04.848431 3620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:04.848644 3602 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:04.848721 3602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "67d3c6bdaf4b4c588867ac2f97d3feda"
format_stamp: "Formatted at 2026-08-09 23:19:04 on dist-test-slave-6nmv"
server_key: "a8a86def035354e891ef67fbe06658af"
server_key_iv: "46e76f74fbb0a0a415fdf5af2c3e702f"
server_key_version: "encryptionkey@0"
I20260809 23:19:04.848768 3602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:04.856777 3602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:04.858651 3602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:04.858755 3602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:04.859180 3602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:04.859220 3602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:04.859241 3602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:04.859253 3602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:04.865924 3602 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:36931
I20260809 23:19:04.866007 3747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:36931 every 8 connection(s)
Aug 09 23:19:04 dist-test-slave-6nmv krb5kdc[3165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317544, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:04.866336 3602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:19:04.866756 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 3602
I20260809 23:19:04.866868 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:19:04.867058 1966 external_mini_cluster.cc:1428] Setting key 828247c529797ec2bbc54dd1ca4c7285
I20260809 23:19:04.869951 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.859660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:37337 (local address 127.1.235.190:37487)
0809 23:19:04.859735 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:04.859738 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:04.859875 (+ 137us) server_negotiation.cc:407] Connection header received
0809 23:19:04.860300 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:04.860301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:04.860313 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:04.860392 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:04.861198 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.862045 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.863554 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.863886 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.863966 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.866717 (+ 2751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:04.866719 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:04.866719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:04.866729 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:04.868523 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:04.869053 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:04.869054 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:04.869054 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:04.869126 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:04.869338 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:04.869339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:04.869339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:04.869445 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:04.869497 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:04.869739 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 23:19:04.869874 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 23:19:04.870168 3630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.859585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:37487 (local address 127.1.235.131:37337)
0809 23:19:04.859744 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:04.859781 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:04.860212 (+ 431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:04.860442 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:04.860445 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:04.860791 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:04.861084 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.861091 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.862147 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.862148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.863428 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.863432 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.863983 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.863984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.864124 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.864669 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:04.864680 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:04.866543 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:04.868721 (+ 2178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:04.868728 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:04.868729 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:04.868969 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:04.869195 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:04.869196 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:04.869196 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:04.869282 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:04.869488 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:04.869491 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:04.869593 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 23:19:04.869704 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 23:19:04.869927 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":81,"threads_started":1}
I20260809 23:19:04.870700 3748 heartbeater.cc:347] Connected to a master server at 127.1.235.190:37487
I20260809 23:19:04.870796 3748 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:04.870965 3748 heartbeater.cc:511] Master 127.1.235.190:37487 requested a full tablet report, sending...
I20260809 23:19:04.871341 3210 ts_manager.cc:194] Registered new tserver with Master: 67d3c6bdaf4b4c588867ac2f97d3feda (127.1.235.131:36931)
I20260809 23:19:04.871830 3210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:37337
I20260809 23:19:04.876744 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.871848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:51561 (local address 127.1.235.190:37487)
0809 23:19:04.871895 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:04.871896 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:04.872044 (+ 148us) server_negotiation.cc:407] Connection header received
0809 23:19:04.872110 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:04.872111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:04.872122 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:04.872179 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:04.872477 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.872918 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.873556 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.873738 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.873845 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.874570 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:04.874571 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:04.874571 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:04.874577 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:04.875628 (+ 1051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:04.875958 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:04.875959 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:04.875960 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:04.876026 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:04.876240 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:04.876241 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:04.876241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:04.876345 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:04.876418 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:04.876589 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 23:19:04.876658 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 23:19:04.876753 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.871769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:37487 (local address 127.1.235.131:51561)
0809 23:19:04.871991 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:04.872003 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:04.872056 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:04.872181 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:04.872182 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:04.872352 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:04.872404 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.872405 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.873010 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.873011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.873463 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.873464 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.873830 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.873831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.873899 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.874233 (+ 334us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:04.874236 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:04.874465 (+ 229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:04.875715 (+ 1250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:04.875716 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:04.875716 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:04.875878 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:04.876109 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:04.876110 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:04.876110 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:04.876168 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:04.876410 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:04.876410 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:04.876454 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 23:19:04.876561 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 23:19:04.876661 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":72,"threads_started":1}
I20260809 23:19:04.878844 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 23:19:04 dist-test-slave-6nmv krb5kdc[3165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317544, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 23:19:04 dist-test-slave-6nmv krb5kdc[3165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317544, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:04.902590 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.895356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44054 (local address 127.1.235.190:37487)
0809 23:19:04.895429 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:04.895431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:04.895439 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:19:04.895459 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:04.895460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:04.895470 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:04.895557 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:04.896220 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.896747 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.897529 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.897741 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.897814 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.900329 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:04.900331 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:04.900331 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:04.900337 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:04.901622 (+ 1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:04.902024 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:04.902025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:04.902025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:04.902073 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:04.902258 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:04.902258 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:04.902258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:04.902335 (+ 77us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:04.902397 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:04.902480 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 23:19:04.902537 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 23:19:04.904172 3210 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44054:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:19:04.905676 3210 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:19:04.912078 3767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.908085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:45173 (local address 127.0.0.1:34210)
0809 23:19:04.908174 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:04.908181 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:04.908212 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:04.908849 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:04.908850 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:04.908852 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:04.908894 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.908895 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.910150 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.910151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.910943 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.910946 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.911827 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.911827 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.911916 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.911928 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 23:19:04.911989 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 23:19:04.912028 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":48,"threads_started":1}
I20260809 23:19:04.912173 3769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.908432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34210 (local address 127.1.235.129:45173)
0809 23:19:04.908678 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:04.908683 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:04.908693 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:19:04.908732 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:04.908735 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:04.908750 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:04.908965 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:04.909024 (+ 59us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.910082 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.911055 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.911742 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.911817 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.911883 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:04.912021 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 23:19:04.912060 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":86,"threads_started":1}
I20260809 23:19:04.912762 3364 tablet_service.cc:1467] Processing CreateTablet for tablet a808ac05fc2a447aad2c537911ffb32e (DEFAULT_TABLE table=test-table [id=90789f428b9c4e9db57083ea7885d98f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:04.913127 3763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.907834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:38871 (local address 127.0.0.1:48532)
0809 23:19:04.907927 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:04.907962 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:04.908033 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:04.908759 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:04.908760 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:04.908763 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:04.908819 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.908821 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.909775 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.909776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.911229 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.911231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.912852 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.912853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.912948 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.912952 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:19:04.913016 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 23:19:04.913058 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72,"mutex_wait_us":60,"thread_start_us":52,"threads_started":1}
I20260809 23:19:04.913226 3364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a808ac05fc2a447aad2c537911ffb32e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:04.913233 3764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.907836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:36931 (local address 127.0.0.1:46152)
0809 23:19:04.907966 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:04.907975 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:04.908026 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:04.908447 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:04.908450 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:04.908452 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:04.908507 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.908508 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.909882 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.909883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.911228 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:04.911231 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.912972 (+ 1741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.912973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:04.913060 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.913064 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:19:04.913094 (+ 30us) client_negotiation.cc:240] Negotiation successful
0809 23:19:04.913137 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"mutex_wait_us":47,"thread_start_us":74,"threads_started":1}
I20260809 23:19:04.913415 3765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.907973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48532 (local address 127.1.235.130:38871)
0809 23:19:04.908464 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:04.908469 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:04.908481 (+ 12us) server_negotiation.cc:407] Connection header received
0809 23:19:04.908523 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:04.908525 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:04.908564 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:04.908678 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:04.908929 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.909677 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.912176 (+ 2499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.912751 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.912811 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.912891 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:04.913253 (+ 362us) server_negotiation.cc:299] Negotiation successful
0809 23:19:04.913298 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":104,"threads_started":1}
I20260809 23:19:04.913411 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:04.908202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46152 (local address 127.1.235.131:36931)
0809 23:19:04.908316 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:04.908319 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:04.908326 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:19:04.908351 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:04.908353 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:04.908363 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:04.908443 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:04.908628 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.909747 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.911313 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:04.912086 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:04.913181 (+ 1095us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:04.913240 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:04.913265 (+ 25us) server_negotiation.cc:299] Negotiation successful
0809 23:19:04.913307 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":62,"threads_started":1}
I20260809 23:19:04.914160 3507 tablet_service.cc:1467] Processing CreateTablet for tablet a808ac05fc2a447aad2c537911ffb32e (DEFAULT_TABLE table=test-table [id=90789f428b9c4e9db57083ea7885d98f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:04.914479 3507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a808ac05fc2a447aad2c537911ffb32e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:04.914752 3673 tablet_service.cc:1467] Processing CreateTablet for tablet a808ac05fc2a447aad2c537911ffb32e (DEFAULT_TABLE table=test-table [id=90789f428b9c4e9db57083ea7885d98f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:04.915197 3673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a808ac05fc2a447aad2c537911ffb32e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:04.917243 3770 tablet_bootstrap.cc:492] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5: Bootstrap starting.
I20260809 23:19:04.917654 3771 tablet_bootstrap.cc:492] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28: Bootstrap starting.
I20260809 23:19:04.917946 3770 tablet_bootstrap.cc:654] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:04.918308 3770 log.cc:824] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:04.918393 3771 tablet_bootstrap.cc:654] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:04.918481 3772 tablet_bootstrap.cc:492] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda: Bootstrap starting.
I20260809 23:19:04.918803 3771 log.cc:824] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:04.919466 3770 tablet_bootstrap.cc:492] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5: No bootstrap required, opened a new log
I20260809 23:19:04.919570 3770 ts_tablet_manager.cc:1397] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 23:19:04.919607 3772 tablet_bootstrap.cc:654] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:04.919921 3772 log.cc:824] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:04.920707 3772 tablet_bootstrap.cc:492] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda: No bootstrap required, opened a new log
I20260809 23:19:04.920758 3772 ts_tablet_manager.cc:1397] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:19:04.921205 3770 raft_consensus.cc:348] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } }
I20260809 23:19:04.921342 3770 raft_consensus.cc:374] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:04.921382 3770 raft_consensus.cc:729] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642e5ca59a38463caa18a04ff2daf7f5, State: Initialized, Role: FOLLOWER
I20260809 23:19:04.921482 3770 consensus_queue.cc:260] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } }
I20260809 23:19:04.921768 3770 ts_tablet_manager.cc:1428] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 23:19:04.921836 3593 heartbeater.cc:503] Master 127.1.235.190:37487 was elected leader, sending a full tablet report...
I20260809 23:19:04.922348 3771 tablet_bootstrap.cc:492] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28: No bootstrap required, opened a new log
I20260809 23:19:04.922400 3771 ts_tablet_manager.cc:1397] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260809 23:19:04.922596 3772 raft_consensus.cc:348] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } }
I20260809 23:19:04.922739 3772 raft_consensus.cc:374] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:04.922783 3772 raft_consensus.cc:729] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67d3c6bdaf4b4c588867ac2f97d3feda, State: Initialized, Role: FOLLOWER
I20260809 23:19:04.922931 3772 consensus_queue.cc:260] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } }
I20260809 23:19:04.923225 3772 ts_tablet_manager.cc:1428] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 23:19:04.923281 3748 heartbeater.cc:503] Master 127.1.235.190:37487 was elected leader, sending a full tablet report...
I20260809 23:19:04.924412 3771 raft_consensus.cc:348] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } }
I20260809 23:19:04.924546 3771 raft_consensus.cc:374] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:04.924568 3771 raft_consensus.cc:729] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d277cf79c964eb189cfca9a60a6ab28, State: Initialized, Role: FOLLOWER
I20260809 23:19:04.924635 3771 consensus_queue.cc:260] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } }
I20260809 23:19:04.924842 3771 ts_tablet_manager.cc:1428] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 23:19:04.924865 3440 heartbeater.cc:503] Master 127.1.235.190:37487 was elected leader, sending a full tablet report...
W20260809 23:19:04.973564 3594 tablet.cc:2369] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:19:05.034327 3779 raft_consensus.cc:482] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:19:05.034461 3779 raft_consensus.cc:504] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } }
I20260809 23:19:05.034809 3779 leader_election.cc:288] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67d3c6bdaf4b4c588867ac2f97d3feda (127.1.235.131:36931), 642e5ca59a38463caa18a04ff2daf7f5 (127.1.235.130:38871)
I20260809 23:19:05.037997 3322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.034979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:36931 (local address 127.1.235.129:60081)
0809 23:19:05.035035 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:05.035060 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:05.035104 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:05.035296 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:05.035298 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:05.035300 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:05.035376 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.035378 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.036098 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.036099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.037143 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.037146 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.037748 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.037749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.037856 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.037861 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 23:19:05.037912 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 23:19:05.037944 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260809 23:19:05.038058 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.035106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:60081 (local address 127.1.235.131:36931)
0809 23:19:05.035151 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:05.035153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:05.035162 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:19:05.035189 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:05.035190 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:05.035200 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:05.035257 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:05.035536 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.036008 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.037230 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.037666 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.037740 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.037748 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:05.037940 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 23:19:05.037983 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 23:19:05.038405 3695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a808ac05fc2a447aad2c537911ffb32e" candidate_uuid: "2d277cf79c964eb189cfca9a60a6ab28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" is_pre_election: true
I20260809 23:19:05.038574 3695 raft_consensus.cc:2454] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d277cf79c964eb189cfca9a60a6ab28 in term 0.
I20260809 23:19:05.038771 3780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.034988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:38871 (local address 127.1.235.129:52109)
0809 23:19:05.035350 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:05.035361 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:05.035637 (+ 276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:05.035761 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:05.035762 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:05.035764 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:05.035844 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.035845 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.036560 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.036561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.037477 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.037479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.038437 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.038438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.038512 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.038515 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:19:05.038647 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 23:19:05.038688 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"mutex_wait_us":165,"thread_start_us":116,"threads_started":1}
I20260809 23:19:05.038771 3765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.035092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:52109 (local address 127.1.235.130:38871)
0809 23:19:05.035156 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:05.035163 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:05.035627 (+ 464us) server_negotiation.cc:407] Connection header received
0809 23:19:05.035694 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:05.035695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:05.035705 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:05.035749 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:05.035940 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.036461 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.037561 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.038178 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.038246 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.038253 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:05.038671 (+ 418us) server_negotiation.cc:299] Negotiation successful
0809 23:19:05.038710 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 23:19:05.039016 3315 leader_election.cc:302] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d277cf79c964eb189cfca9a60a6ab28, 67d3c6bdaf4b4c588867ac2f97d3feda; no voters:
I20260809 23:19:05.039139 3779 raft_consensus.cc:2781] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:19:05.039109 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a808ac05fc2a447aad2c537911ffb32e" candidate_uuid: "2d277cf79c964eb189cfca9a60a6ab28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642e5ca59a38463caa18a04ff2daf7f5" is_pre_election: true
I20260809 23:19:05.039201 3779 raft_consensus.cc:482] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:19:05.039247 3779 raft_consensus.cc:3037] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:05.039256 3545 raft_consensus.cc:2454] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d277cf79c964eb189cfca9a60a6ab28 in term 0.
I20260809 23:19:05.039963 3779 raft_consensus.cc:504] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } }
I20260809 23:19:05.040125 3779 leader_election.cc:288] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [CANDIDATE]: Term 1 election: Requested vote from peers 67d3c6bdaf4b4c588867ac2f97d3feda (127.1.235.131:36931), 642e5ca59a38463caa18a04ff2daf7f5 (127.1.235.130:38871)
I20260809 23:19:05.040287 3695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a808ac05fc2a447aad2c537911ffb32e" candidate_uuid: "2d277cf79c964eb189cfca9a60a6ab28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda"
I20260809 23:19:05.040365 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a808ac05fc2a447aad2c537911ffb32e" candidate_uuid: "2d277cf79c964eb189cfca9a60a6ab28" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642e5ca59a38463caa18a04ff2daf7f5"
I20260809 23:19:05.040407 3695 raft_consensus.cc:3037] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:05.040445 3545 raft_consensus.cc:3037] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:05.041334 3545 raft_consensus.cc:2454] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d277cf79c964eb189cfca9a60a6ab28 in term 1.
I20260809 23:19:05.041374 3695 raft_consensus.cc:2454] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d277cf79c964eb189cfca9a60a6ab28 in term 1.
I20260809 23:19:05.041514 3315 leader_election.cc:302] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d277cf79c964eb189cfca9a60a6ab28, 67d3c6bdaf4b4c588867ac2f97d3feda; no voters:
I20260809 23:19:05.041610 3779 raft_consensus.cc:2781] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:05.041777 3779 raft_consensus.cc:686] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [term 1 LEADER]: Becoming Leader. State: Replica: 2d277cf79c964eb189cfca9a60a6ab28, State: Running, Role: LEADER
I20260809 23:19:05.041893 3779 consensus_queue.cc:237] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } }
I20260809 23:19:05.042773 3210 catalog_manager.cc:5495] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d277cf79c964eb189cfca9a60a6ab28 (127.1.235.129). New cstate: current_term: 1 leader_uuid: "2d277cf79c964eb189cfca9a60a6ab28" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } health_report { overall_health: HEALTHY } } }
I20260809 23:19:05.058507 3769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.056347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34212 (local address 127.1.235.129:45173)
0809 23:19:05.056412 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:05.056414 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:05.056421 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:19:05.056484 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:05.056485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:05.056499 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:05.056554 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:19:05.056656 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.057052 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.057731 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.057977 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.058030 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.058242 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:19:05.058320 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:19:05.058370 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:05.058403 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 23:19:05.058418 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260809 23:19:05.060467 3441 tablet.cc:2369] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:19:05.060776 3695 raft_consensus.cc:1261] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda [term 1 FOLLOWER]: Refusing update from remote peer 2d277cf79c964eb189cfca9a60a6ab28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:05.061146 3781 consensus_queue.cc:1035] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:05.063220 3545 raft_consensus.cc:1261] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5 [term 1 FOLLOWER]: Refusing update from remote peer 2d277cf79c964eb189cfca9a60a6ab28: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:05.063480 3781 consensus_queue.cc:1035] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [LEADER]: Connected to new peer: Peer: permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:05.063556 3784 mvcc.cc:205] Tried to move back new op lower bound from 7316756664566202368 to 7316756664492118016. Current Snapshot: MvccSnapshot[applied={T|T < 7316756664566202368}]
I20260809 23:19:05.064065 3785 mvcc.cc:205] Tried to move back new op lower bound from 7316756664566202368 to 7316756664492118016. Current Snapshot: MvccSnapshot[applied={T|T < 7316756664566202368}]
I20260809 23:19:05.068787 3210 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:05.068892 3210 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:05.069990 3210 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6: Sending DeleteTablet for 3 replicas of tablet a808ac05fc2a447aad2c537911ffb32e
I20260809 23:19:05.070564 3673 tablet_service.cc:1514] Processing DeleteTablet for tablet a808ac05fc2a447aad2c537911ffb32e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:05 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:46152
I20260809 23:19:05.070565 3507 tablet_service.cc:1514] Processing DeleteTablet for tablet a808ac05fc2a447aad2c537911ffb32e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:05 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:48532
I20260809 23:19:05.070807 3364 tablet_service.cc:1514] Processing DeleteTablet for tablet a808ac05fc2a447aad2c537911ffb32e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:05 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:34210
I20260809 23:19:05.070785 3210 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44054:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:19:05.070921 3210 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:19:05.071091 3796 tablet_replica.cc:330] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5: stopping tablet replica
I20260809 23:19:05.071197 3796 raft_consensus.cc:2229] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:05.071337 3797 tablet_replica.cc:330] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda: stopping tablet replica
I20260809 23:19:05.071476 3797 raft_consensus.cc:2229] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:05.071727 3798 tablet_replica.cc:330] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28: stopping tablet replica
I20260809 23:19:05.071738 3797 raft_consensus.cc:2258] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:05.071828 3798 raft_consensus.cc:2229] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:19:05.072031 3798 raft_consensus.cc:2258] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:05.072263 3364 tablet_service.cc:1467] Processing CreateTablet for tablet 3accc67ab63e44f0bda4a6480d7d43f9 (DEFAULT_TABLE table=test-table [id=90461f1521704b429eac9f79f771c41c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:05.072329 3507 tablet_service.cc:1467] Processing CreateTablet for tablet 3accc67ab63e44f0bda4a6480d7d43f9 (DEFAULT_TABLE table=test-table [id=90461f1521704b429eac9f79f771c41c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:05.072387 3364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3accc67ab63e44f0bda4a6480d7d43f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:05.072424 3507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3accc67ab63e44f0bda4a6480d7d43f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:05.072432 3797 ts_tablet_manager.cc:1905] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:05.073724 3770 tablet_bootstrap.cc:492] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5: Bootstrap starting.
I20260809 23:19:05.073850 3771 tablet_bootstrap.cc:492] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28: Bootstrap starting.
I20260809 23:19:05.074219 3771 tablet_bootstrap.cc:654] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:05.074215 3770 tablet_bootstrap.cc:654] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:05.074605 3797 ts_tablet_manager.cc:1918] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:19:05.074682 3797 log.cc:1196] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/a808ac05fc2a447aad2c537911ffb32e
I20260809 23:19:05.074697 3673 tablet_service.cc:1467] Processing CreateTablet for tablet 3accc67ab63e44f0bda4a6480d7d43f9 (DEFAULT_TABLE table=test-table [id=90461f1521704b429eac9f79f771c41c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:05.074807 3673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3accc67ab63e44f0bda4a6480d7d43f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:05.074962 3797 ts_tablet_manager.cc:1939] T a808ac05fc2a447aad2c537911ffb32e P 67d3c6bdaf4b4c588867ac2f97d3feda: Deleting consensus metadata
I20260809 23:19:05.075757 3770 tablet_bootstrap.cc:492] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5: No bootstrap required, opened a new log
I20260809 23:19:05.075803 3770 ts_tablet_manager.cc:1397] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:19:05.076064 3772 tablet_bootstrap.cc:492] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda: Bootstrap starting.
I20260809 23:19:05.076087 3198 catalog_manager.cc:4841] TS 67d3c6bdaf4b4c588867ac2f97d3feda (127.1.235.131:36931): tablet a808ac05fc2a447aad2c537911ffb32e (table test-table [id=90789f428b9c4e9db57083ea7885d98f]) successfully deleted
I20260809 23:19:05.076499 3772 tablet_bootstrap.cc:654] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:05.076566 3770 raft_consensus.cc:348] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.076658 3770 raft_consensus.cc:374] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:05.076684 3770 raft_consensus.cc:729] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642e5ca59a38463caa18a04ff2daf7f5, State: Initialized, Role: FOLLOWER
I20260809 23:19:05.076730 3770 consensus_queue.cc:260] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.076846 3770 ts_tablet_manager.cc:1428] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:05.076582 3796 raft_consensus.cc:2258] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:05.077067 3772 tablet_bootstrap.cc:492] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda: No bootstrap required, opened a new log
I20260809 23:19:05.077106 3772 ts_tablet_manager.cc:1397] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:05.077255 3772 raft_consensus.cc:348] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.077276 3798 ts_tablet_manager.cc:1905] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:05.077324 3772 raft_consensus.cc:374] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:05.077345 3772 raft_consensus.cc:729] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67d3c6bdaf4b4c588867ac2f97d3feda, State: Initialized, Role: FOLLOWER
I20260809 23:19:05.077384 3772 consensus_queue.cc:260] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.077462 3772 ts_tablet_manager.cc:1428] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:05.078925 3771 tablet_bootstrap.cc:492] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28: No bootstrap required, opened a new log
I20260809 23:19:05.078977 3771 ts_tablet_manager.cc:1397] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260809 23:19:05.079049 3798 ts_tablet_manager.cc:1918] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:19:05.079057 3796 ts_tablet_manager.cc:1905] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:05.079120 3798 log.cc:1196] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/wal/wals/a808ac05fc2a447aad2c537911ffb32e
I20260809 23:19:05.079137 3771 raft_consensus.cc:348] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.079208 3771 raft_consensus.cc:374] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:05.079233 3771 raft_consensus.cc:729] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d277cf79c964eb189cfca9a60a6ab28, State: Initialized, Role: FOLLOWER
I20260809 23:19:05.079284 3771 consensus_queue.cc:260] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.079365 3771 ts_tablet_manager.cc:1428] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:05.079385 3798 ts_tablet_manager.cc:1939] T a808ac05fc2a447aad2c537911ffb32e P 2d277cf79c964eb189cfca9a60a6ab28: Deleting consensus metadata
I20260809 23:19:05.079748 3198 catalog_manager.cc:4841] TS 2d277cf79c964eb189cfca9a60a6ab28 (127.1.235.129:45173): tablet a808ac05fc2a447aad2c537911ffb32e (table test-table [id=90789f428b9c4e9db57083ea7885d98f]) successfully deleted
I20260809 23:19:05.080790 3796 ts_tablet_manager.cc:1918] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:19:05.080883 3796 log.cc:1196] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/a808ac05fc2a447aad2c537911ffb32e
I20260809 23:19:05.081115 3796 ts_tablet_manager.cc:1939] T a808ac05fc2a447aad2c537911ffb32e P 642e5ca59a38463caa18a04ff2daf7f5: Deleting consensus metadata
I20260809 23:19:05.081467 3197 catalog_manager.cc:4841] TS 642e5ca59a38463caa18a04ff2daf7f5 (127.1.235.130:38871): tablet a808ac05fc2a447aad2c537911ffb32e (table test-table [id=90789f428b9c4e9db57083ea7885d98f]) successfully deleted
I20260809 23:19:05.090289 3778 raft_consensus.cc:482] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:19:05.090368 3778 raft_consensus.cc:504] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.090683 3778 leader_election.cc:288] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d277cf79c964eb189cfca9a60a6ab28 (127.1.235.129:45173), 642e5ca59a38463caa18a04ff2daf7f5 (127.1.235.130:38871)
I20260809 23:19:05.093932 3765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.091055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:51519 (local address 127.1.235.130:38871)
0809 23:19:05.091095 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:05.091097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:05.091108 (+ 11us) server_negotiation.cc:407] Connection header received
0809 23:19:05.091180 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:05.091180 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:05.091188 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:05.091245 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:05.091432 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.092137 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.093135 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.093527 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.093601 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.093611 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:05.093827 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 23:19:05.093869 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 23:19:05.093961 3802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.090864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:38871 (local address 127.1.235.131:51519)
0809 23:19:05.091062 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:05.091072 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:05.091125 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:05.091261 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:05.091262 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:05.091264 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:05.091358 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.091359 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.092222 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.092223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.093041 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.093044 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.093624 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.093625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.093699 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.093704 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 23:19:05.093774 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 23:19:05.093813 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":8,"thread_start_us":78,"threads_started":1}
I20260809 23:19:05.094215 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3accc67ab63e44f0bda4a6480d7d43f9" candidate_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642e5ca59a38463caa18a04ff2daf7f5" is_pre_election: true
I20260809 23:19:05.094305 3545 raft_consensus.cc:2454] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67d3c6bdaf4b4c588867ac2f97d3feda in term 0.
I20260809 23:19:05.094475 3623 leader_election.cc:302] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642e5ca59a38463caa18a04ff2daf7f5, 67d3c6bdaf4b4c588867ac2f97d3feda; no voters:
I20260809 23:19:05.094575 3630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.090858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:45173 (local address 127.1.235.131:35529)
0809 23:19:05.090928 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:05.090939 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:05.090983 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:05.091178 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:05.091179 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:05.091181 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:05.091249 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.091251 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.092193 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.092194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.093406 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.093409 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.094259 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.094260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.094357 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.094361 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:19:05.094412 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 23:19:05.094452 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":43}
I20260809 23:19:05.094601 3769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.090898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:35529 (local address 127.1.235.129:45173)
0809 23:19:05.090956 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:05.090958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:05.090968 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:19:05.091075 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:05.091076 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:05.091087 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:05.091135 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:05.091312 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.092107 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.093502 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.094120 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.094206 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.094214 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:05.094504 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 23:19:05.094543 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 23:19:05.094614 3778 raft_consensus.cc:2781] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:19:05.094645 3778 raft_consensus.cc:482] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:19:05.094666 3778 raft_consensus.cc:3037] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:05.095002 3391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3accc67ab63e44f0bda4a6480d7d43f9" candidate_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d277cf79c964eb189cfca9a60a6ab28" is_pre_election: true
I20260809 23:19:05.095141 3391 raft_consensus.cc:2454] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67d3c6bdaf4b4c588867ac2f97d3feda in term 0.
I20260809 23:19:05.095711 3778 raft_consensus.cc:504] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.095842 3778 leader_election.cc:288] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [CANDIDATE]: Term 1 election: Requested vote from peers 2d277cf79c964eb189cfca9a60a6ab28 (127.1.235.129:45173), 642e5ca59a38463caa18a04ff2daf7f5 (127.1.235.130:38871)
I20260809 23:19:05.096000 3545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3accc67ab63e44f0bda4a6480d7d43f9" candidate_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "642e5ca59a38463caa18a04ff2daf7f5"
I20260809 23:19:05.096077 3545 raft_consensus.cc:3037] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:05.096783 3545 raft_consensus.cc:2454] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67d3c6bdaf4b4c588867ac2f97d3feda in term 1.
I20260809 23:19:05.096933 3623 leader_election.cc:302] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642e5ca59a38463caa18a04ff2daf7f5, 67d3c6bdaf4b4c588867ac2f97d3feda; no voters:
I20260809 23:19:05.096977 3391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3accc67ab63e44f0bda4a6480d7d43f9" candidate_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d277cf79c964eb189cfca9a60a6ab28"
I20260809 23:19:05.097023 3778 raft_consensus.cc:2781] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:05.097061 3391 raft_consensus.cc:3037] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:05.097159 3778 raft_consensus.cc:686] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [term 1 LEADER]: Becoming Leader. State: Replica: 67d3c6bdaf4b4c588867ac2f97d3feda, State: Running, Role: LEADER
I20260809 23:19:05.097234 3778 consensus_queue.cc:237] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.097972 3391 raft_consensus.cc:2454] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67d3c6bdaf4b4c588867ac2f97d3feda in term 1.
I20260809 23:19:05.097945 3210 catalog_manager.cc:5495] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda reported cstate change: term changed from 0 to 1, leader changed from <none> to 67d3c6bdaf4b4c588867ac2f97d3feda (127.1.235.131). New cstate: current_term: 1 leader_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } health_report { overall_health: HEALTHY } } }
W20260809 23:19:05.117069 3749 tablet.cc:2369] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 23:19:05 dist-test-slave-6nmv krb5kdc[3165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317544, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:05.126708 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.118697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44056 (local address 127.1.235.190:37487)
0809 23:19:05.118753 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:05.118756 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:05.118875 (+ 119us) server_negotiation.cc:407] Connection header received
0809 23:19:05.118943 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:05.118944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:05.118955 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:05.119022 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:05.119597 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.120089 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.121154 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.121334 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.121411 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.123935 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:05.123936 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:05.123937 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:05.123942 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:05.125400 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:05.125801 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:05.125803 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:05.125803 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:05.125896 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:05.126096 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:05.126097 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:05.126097 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:05.126223 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:05.126325 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:05.126507 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 23:19:05.126593 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 23:19:05.126824 3810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.118602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:37487 (local address 127.0.0.1:44056)
0809 23:19:05.118789 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:05.118801 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:05.118875 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:05.119043 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:05.119045 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:05.119455 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:05.119512 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.119515 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.120168 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.120169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.121049 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.121051 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.121416 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.121417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.121479 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.122079 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:05.122085 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:05.123802 (+ 1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:05.125503 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:05.125511 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:05.125525 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:05.125726 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:05.125965 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:05.125965 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:05.125966 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:05.126026 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:05.126344 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:05.126352 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:05.126414 (+ 62us) client_negotiation.cc:769] Sending connection context
0809 23:19:05.126482 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 23:19:05.126657 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":69,"thread_start_us":103,"threads_started":1}
I20260809 23:19:05.129060 3210 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:44056:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 23:19:05.129336 3210 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:19:05.130888 3673 tablet_service.cc:1467] Processing CreateTablet for tablet 047b6e04d0054001a21818489ccd86cc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5b95d93039f545829804ad343ea0d1ef]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 23:19:05.130949 3507 tablet_service.cc:1467] Processing CreateTablet for tablet 047b6e04d0054001a21818489ccd86cc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5b95d93039f545829804ad343ea0d1ef]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 23:19:05.131106 3673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 047b6e04d0054001a21818489ccd86cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:05.131119 3507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 047b6e04d0054001a21818489ccd86cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:05.132658 3770 tablet_bootstrap.cc:492] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5: Bootstrap starting.
I20260809 23:19:05.132679 3772 tablet_bootstrap.cc:492] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda: Bootstrap starting.
I20260809 23:19:05.133060 3770 tablet_bootstrap.cc:654] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:05.133129 3772 tablet_bootstrap.cc:654] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:05.130895 3364 tablet_service.cc:1467] Processing CreateTablet for tablet 047b6e04d0054001a21818489ccd86cc (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=5b95d93039f545829804ad343ea0d1ef]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 23:19:05.133574 3364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 047b6e04d0054001a21818489ccd86cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:05.134562 3770 tablet_bootstrap.cc:492] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5: No bootstrap required, opened a new log
I20260809 23:19:05.134617 3770 ts_tablet_manager.cc:1397] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260809 23:19:05.134797 3770 raft_consensus.cc:348] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.134893 3770 raft_consensus.cc:374] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:05.134936 3770 raft_consensus.cc:729] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642e5ca59a38463caa18a04ff2daf7f5, State: Initialized, Role: FOLLOWER
I20260809 23:19:05.134985 3770 consensus_queue.cc:260] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.135078 3771 tablet_bootstrap.cc:492] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28: Bootstrap starting.
I20260809 23:19:05.135087 3770 ts_tablet_manager.cc:1428] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:05.135239 3777 tablet_replica.cc:439] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } }
I20260809 23:19:05.135356 3777 tablet_replica.cc:442] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:19:05.135408 3771 tablet_bootstrap.cc:654] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:05.136109 3771 tablet_bootstrap.cc:492] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28: No bootstrap required, opened a new log
I20260809 23:19:05.136152 3771 ts_tablet_manager.cc:1397] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 23:19:05.136238 3771 raft_consensus.cc:348] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.136286 3771 raft_consensus.cc:374] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:05.136300 3771 raft_consensus.cc:729] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d277cf79c964eb189cfca9a60a6ab28, State: Initialized, Role: FOLLOWER
I20260809 23:19:05.136360 3771 consensus_queue.cc:260] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.136464 3771 ts_tablet_manager.cc:1428] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:05.136518 3790 tablet_replica.cc:439] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } }
I20260809 23:19:05.136602 3790 tablet_replica.cc:442] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:19:05.137221 3772 tablet_bootstrap.cc:492] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda: No bootstrap required, opened a new log
I20260809 23:19:05.137293 3772 ts_tablet_manager.cc:1397] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260809 23:19:05.137441 3772 raft_consensus.cc:348] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.137519 3772 raft_consensus.cc:374] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:05.137543 3772 raft_consensus.cc:729] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67d3c6bdaf4b4c588867ac2f97d3feda, State: Initialized, Role: FOLLOWER
I20260809 23:19:05.137591 3772 consensus_queue.cc:260] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.137701 3772 ts_tablet_manager.cc:1428] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:05.137753 3803 tablet_replica.cc:439] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } }
I20260809 23:19:05.138486 3803 tablet_replica.cc:442] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:19:05.205602 3777 raft_consensus.cc:482] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:19:05.205752 3777 raft_consensus.cc:504] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.206166 3777 leader_election.cc:288] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d277cf79c964eb189cfca9a60a6ab28 (127.1.235.129:45173), 67d3c6bdaf4b4c588867ac2f97d3feda (127.1.235.131:36931)
I20260809 23:19:05.208842 3476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.206317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:45173 (local address 127.1.235.130:60405)
0809 23:19:05.206388 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:05.206399 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:05.206438 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:05.206627 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:05.206627 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:05.206629 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:05.206704 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.206705 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.207307 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.207308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.208029 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.208030 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.208576 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.208577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.208666 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.208669 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:19:05.208734 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 23:19:05.208772 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 23:19:05.208843 3769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.206407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:60405 (local address 127.1.235.129:45173)
0809 23:19:05.206469 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:05.206471 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:05.206482 (+ 11us) server_negotiation.cc:407] Connection header received
0809 23:19:05.206510 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:05.206511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:05.206520 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:05.206582 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:05.206775 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.207222 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.208118 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.208461 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.208561 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.208570 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:05.208738 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 23:19:05.208774 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 23:19:05.209017 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.206535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:59811 (local address 127.1.235.131:36931)
0809 23:19:05.206573 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:05.206575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:05.206585 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:19:05.206673 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:05.206675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:05.206683 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:05.206749 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:05.206914 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.207370 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.208288 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.208663 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.208747 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.208754 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:05.208913 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 23:19:05.208952 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:19:05.209035 3814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.206440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:36931 (local address 127.1.235.130:59811)
0809 23:19:05.206544 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:05.206552 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:05.206591 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:05.206751 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:05.206752 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:05.206754 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:05.206848 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.206849 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.207451 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.207452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.208196 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.208197 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.208746 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.208747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.208838 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.208841 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:19:05.208908 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 23:19:05.208944 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":85,"threads_started":1}
I20260809 23:19:05.209121 3391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "047b6e04d0054001a21818489ccd86cc" candidate_uuid: "642e5ca59a38463caa18a04ff2daf7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d277cf79c964eb189cfca9a60a6ab28" is_pre_election: true
I20260809 23:19:05.209200 3391 raft_consensus.cc:2454] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 642e5ca59a38463caa18a04ff2daf7f5 in term 0.
I20260809 23:19:05.209398 3471 leader_election.cc:302] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d277cf79c964eb189cfca9a60a6ab28, 642e5ca59a38463caa18a04ff2daf7f5; no voters:
I20260809 23:19:05.209568 3777 raft_consensus.cc:2781] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:19:05.209638 3777 raft_consensus.cc:482] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:19:05.209666 3777 raft_consensus.cc:3037] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:05.209681 3695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "047b6e04d0054001a21818489ccd86cc" candidate_uuid: "642e5ca59a38463caa18a04ff2daf7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" is_pre_election: true
I20260809 23:19:05.209774 3695 raft_consensus.cc:2454] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 642e5ca59a38463caa18a04ff2daf7f5 in term 0.
I20260809 23:19:05.210822 3777 raft_consensus.cc:504] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.210947 3777 leader_election.cc:288] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [CANDIDATE]: Term 1 election: Requested vote from peers 2d277cf79c964eb189cfca9a60a6ab28 (127.1.235.129:45173), 67d3c6bdaf4b4c588867ac2f97d3feda (127.1.235.131:36931)
I20260809 23:19:05.211112 3695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "047b6e04d0054001a21818489ccd86cc" candidate_uuid: "642e5ca59a38463caa18a04ff2daf7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda"
I20260809 23:19:05.211112 3391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "047b6e04d0054001a21818489ccd86cc" candidate_uuid: "642e5ca59a38463caa18a04ff2daf7f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d277cf79c964eb189cfca9a60a6ab28"
I20260809 23:19:05.211186 3391 raft_consensus.cc:3037] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:05.211186 3695 raft_consensus.cc:3037] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:05.211964 3391 raft_consensus.cc:2454] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642e5ca59a38463caa18a04ff2daf7f5 in term 1.
I20260809 23:19:05.211958 3695 raft_consensus.cc:2454] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 642e5ca59a38463caa18a04ff2daf7f5 in term 1.
I20260809 23:19:05.212146 3471 leader_election.cc:302] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 642e5ca59a38463caa18a04ff2daf7f5, 67d3c6bdaf4b4c588867ac2f97d3feda; no voters:
I20260809 23:19:05.212236 3777 raft_consensus.cc:2781] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:05.212374 3777 raft_consensus.cc:686] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [term 1 LEADER]: Becoming Leader. State: Replica: 642e5ca59a38463caa18a04ff2daf7f5, State: Running, Role: LEADER
I20260809 23:19:05.212455 3777 consensus_queue.cc:237] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } }
I20260809 23:19:05.212788 3815 tablet_replica.cc:439] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5: TxnStatusTablet state changed. Reason: New leader 642e5ca59a38463caa18a04ff2daf7f5. Latest consensus state: current_term: 1 leader_uuid: "642e5ca59a38463caa18a04ff2daf7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } }
I20260809 23:19:05.212910 3815 tablet_replica.cc:442] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5: This TxnStatusTablet replica's current role is: LEADER
I20260809 23:19:05.213140 3817 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 23:19:05.213224 3817 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 23:19:05.213163 3210 catalog_manager.cc:5495] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 642e5ca59a38463caa18a04ff2daf7f5 (127.1.235.130). New cstate: current_term: 1 leader_uuid: "642e5ca59a38463caa18a04ff2daf7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } health_report { overall_health: UNKNOWN } } }
I20260809 23:19:05.228968 3765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.226541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48544 (local address 127.1.235.130:38871)
0809 23:19:05.226601 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:05.226603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:05.226620 (+ 17us) server_negotiation.cc:407] Connection header received
0809 23:19:05.226695 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:05.226696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:05.226710 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:05.226755 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:19:05.226859 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.227250 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.228262 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.228427 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.228479 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.228693 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:19:05.228774 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:19:05.228824 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:05.228907 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 23:19:05.228923 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 23:19:05.229019 3810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.226475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:38871 (local address 127.0.0.1:48544)
0809 23:19:05.226573 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:05.226584 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:05.226629 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:05.226766 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:05.226767 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:05.226767 (+ 0us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 23:19:05.226811 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.226813 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.227321 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.227321 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.228190 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.228192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.228498 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.228499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.228575 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.228591 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 23:19:05.228836 (+ 245us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 23:19:05.228844 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 23:19:05.228893 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 23:19:05.228940 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260809 23:19:05.230165 3695 raft_consensus.cc:1261] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda [term 1 FOLLOWER]: Refusing update from remote peer 642e5ca59a38463caa18a04ff2daf7f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:05.230227 3391 raft_consensus.cc:1261] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28 [term 1 FOLLOWER]: Refusing update from remote peer 642e5ca59a38463caa18a04ff2daf7f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:05.230468 3815 consensus_queue.cc:1035] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:05.230599 3777 consensus_queue.cc:1035] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:05.231189 3790 tablet_replica.cc:439] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28: TxnStatusTablet state changed. Reason: New leader 642e5ca59a38463caa18a04ff2daf7f5. Latest consensus state: current_term: 1 leader_uuid: "642e5ca59a38463caa18a04ff2daf7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } }
I20260809 23:19:05.231280 3790 tablet_replica.cc:442] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:19:05.231258 3803 tablet_replica.cc:439] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda: TxnStatusTablet state changed. Reason: New leader 642e5ca59a38463caa18a04ff2daf7f5. Latest consensus state: current_term: 1 leader_uuid: "642e5ca59a38463caa18a04ff2daf7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } }
I20260809 23:19:05.231344 3803 tablet_replica.cc:442] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:19:05.232303 3815 tablet_replica.cc:439] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "642e5ca59a38463caa18a04ff2daf7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } }
I20260809 23:19:05.232362 3803 tablet_replica.cc:439] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "642e5ca59a38463caa18a04ff2daf7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } }
I20260809 23:19:05.232447 3803 tablet_replica.cc:442] T 047b6e04d0054001a21818489ccd86cc P 67d3c6bdaf4b4c588867ac2f97d3feda: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:19:05.232460 3815 tablet_replica.cc:442] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5: This TxnStatusTablet replica's current role is: LEADER
I20260809 23:19:05.233685 3790 tablet_replica.cc:439] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "642e5ca59a38463caa18a04ff2daf7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } }
I20260809 23:19:05.233767 3790 tablet_replica.cc:442] T 047b6e04d0054001a21818489ccd86cc P 2d277cf79c964eb189cfca9a60a6ab28: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:19:05.234037 3777 tablet_replica.cc:439] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "642e5ca59a38463caa18a04ff2daf7f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 } } peers { permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 } } peers { permanent_uuid: "67d3c6bdaf4b4c588867ac2f97d3feda" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36931 } } }
I20260809 23:19:05.234123 3777 tablet_replica.cc:442] T 047b6e04d0054001a21818489ccd86cc P 642e5ca59a38463caa18a04ff2daf7f5: This TxnStatusTablet replica's current role is: LEADER
I20260809 23:19:05.237076 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.234533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46168 (local address 127.1.235.131:36931)
0809 23:19:05.234573 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:05.234575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:05.234594 (+ 19us) server_negotiation.cc:407] Connection header received
0809 23:19:05.234665 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:05.234666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:05.234683 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:05.234740 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:19:05.234851 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.235476 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.236431 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.236588 (+ 157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.236638 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.236797 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:19:05.236907 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:19:05.236960 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:05.237022 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 23:19:05.237036 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:19:05.241771 3765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.239486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:45753 (local address 127.1.235.130:38871)
0809 23:19:05.239527 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:05.239529 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:05.239538 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:19:05.239621 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:05.239622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:05.239631 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:05.239685 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:19:05.239828 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.240228 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.241037 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.241261 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.241330 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.241548 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:19:05.241578 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:19:05.241617 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:05.241676 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 23:19:05.241693 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:19:05.241775 3754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.239423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:38871 (local address 127.1.235.131:45753)
0809 23:19:05.239497 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:05.239509 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:05.239552 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:05.239688 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:05.239689 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:05.239690 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 23:19:05.239748 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.239749 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.240302 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.240303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.240934 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.240936 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.241331 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.241332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.241401 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.241429 (+ 28us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 23:19:05.241633 (+ 204us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 23:19:05.241635 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:19:05.241676 (+ 41us) client_negotiation.cc:240] Negotiation successful
0809 23:19:05.241713 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 23:19:05.243764 3391 raft_consensus.cc:1261] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28 [term 1 FOLLOWER]: Refusing update from remote peer 67d3c6bdaf4b4c588867ac2f97d3feda: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:05.243773 3545 raft_consensus.cc:1261] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5 [term 1 FOLLOWER]: Refusing update from remote peer 67d3c6bdaf4b4c588867ac2f97d3feda: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:05.244045 3778 consensus_queue.cc:1035] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d277cf79c964eb189cfca9a60a6ab28" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:05.244138 3803 consensus_queue.cc:1035] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [LEADER]: Connected to new peer: Peer: permanent_uuid: "642e5ca59a38463caa18a04ff2daf7f5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:05.245926 3791 mvcc.cc:205] Tried to move back new op lower bound from 7316756665316724736 to 7316756664718966784. Current Snapshot: MvccSnapshot[applied={T|T < 7316756665316724736}]
I20260809 23:19:05.253005 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.250269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:60451 (local address 127.1.235.131:36931)
0809 23:19:05.250306 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:05.250308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:05.250444 (+ 136us) server_negotiation.cc:407] Connection header received
0809 23:19:05.250501 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:05.250501 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:05.250509 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:05.250559 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:19:05.250727 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.251094 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.252166 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.252462 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.252498 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.252842 (+ 344us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:19:05.252871 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:19:05.252906 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:05.252957 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 23:19:05.252968 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 23:19:05.253062 3832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.250221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:36931 (local address 127.1.235.130:60451)
0809 23:19:05.250373 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:05.250382 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:05.250442 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:05.250595 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:05.250596 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:05.250597 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 23:19:05.250656 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.250658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.251161 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.251162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.252072 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:05.252075 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.252648 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.252649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:05.252749 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.252764 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 23:19:05.252917 (+ 153us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 23:19:05.252919 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:19:05.252948 (+ 29us) client_negotiation.cc:240] Negotiation successful
0809 23:19:05.252985 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":95,"threads_started":1}
I20260809 23:19:05.263012 3211 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:05.263123 3211 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:05.263747 3211 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38881f42134644f3857440049d7799e6: Sending DeleteTablet for 3 replicas of tablet 3accc67ab63e44f0bda4a6480d7d43f9
I20260809 23:19:05.264002 3673 tablet_service.cc:1514] Processing DeleteTablet for tablet 3accc67ab63e44f0bda4a6480d7d43f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:05 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:46152
I20260809 23:19:05.264012 3364 tablet_service.cc:1514] Processing DeleteTablet for tablet 3accc67ab63e44f0bda4a6480d7d43f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:05 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:34210
I20260809 23:19:05.264093 3798 tablet_replica.cc:330] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28: stopping tablet replica
I20260809 23:19:05.264093 3797 tablet_replica.cc:330] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda: stopping tablet replica
I20260809 23:19:05.264139 3798 raft_consensus.cc:2229] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:05.264138 3797 raft_consensus.cc:2229] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:19:05.264170 3798 raft_consensus.cc:2258] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:05.264226 3797 raft_consensus.cc:2258] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:05.264513 3798 ts_tablet_manager.cc:1905] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:05.264540 3797 ts_tablet_manager.cc:1905] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:05.265787 3507 tablet_service.cc:1514] Processing DeleteTablet for tablet 3accc67ab63e44f0bda4a6480d7d43f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:05 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:48532
I20260809 23:19:05.265961 3797 ts_tablet_manager.cc:1918] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 23:19:05.266016 3797 log.cc:1196] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/3accc67ab63e44f0bda4a6480d7d43f9
I20260809 23:19:05.266276 3797 ts_tablet_manager.cc:1939] T 3accc67ab63e44f0bda4a6480d7d43f9 P 67d3c6bdaf4b4c588867ac2f97d3feda: Deleting consensus metadata
I20260809 23:19:05.266575 3198 catalog_manager.cc:4841] TS 67d3c6bdaf4b4c588867ac2f97d3feda (127.1.235.131:36931): tablet 3accc67ab63e44f0bda4a6480d7d43f9 (table test-table [id=90461f1521704b429eac9f79f771c41c]) successfully deleted
I20260809 23:19:05.268045 3796 tablet_replica.cc:330] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5: stopping tablet replica
I20260809 23:19:05.268116 3796 raft_consensus.cc:2229] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:05.268162 3796 raft_consensus.cc:2258] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:05.268226 3798 ts_tablet_manager.cc:1918] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 23:19:05.268314 3798 log.cc:1196] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-0/wal/wals/3accc67ab63e44f0bda4a6480d7d43f9
I20260809 23:19:05.268513 3796 ts_tablet_manager.cc:1905] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:05.268702 3798 ts_tablet_manager.cc:1939] T 3accc67ab63e44f0bda4a6480d7d43f9 P 2d277cf79c964eb189cfca9a60a6ab28: Deleting consensus metadata
I20260809 23:19:05.269025 3198 catalog_manager.cc:4841] TS 2d277cf79c964eb189cfca9a60a6ab28 (127.1.235.129:45173): tablet 3accc67ab63e44f0bda4a6480d7d43f9 (table test-table [id=90461f1521704b429eac9f79f771c41c]) successfully deleted
I20260809 23:19:05.270293 3796 ts_tablet_manager.cc:1918] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 23:19:05.270364 3796 log.cc:1196] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/3accc67ab63e44f0bda4a6480d7d43f9
I20260809 23:19:05.270596 3796 ts_tablet_manager.cc:1939] T 3accc67ab63e44f0bda4a6480d7d43f9 P 642e5ca59a38463caa18a04ff2daf7f5: Deleting consensus metadata
I20260809 23:19:05.270916 3197 catalog_manager.cc:4841] TS 642e5ca59a38463caa18a04ff2daf7f5 (127.1.235.130:38871): tablet 3accc67ab63e44f0bda4a6480d7d43f9 (table test-table [id=90461f1521704b429eac9f79f771c41c]) successfully deleted
Aug 09 23:19:05 dist-test-slave-6nmv krb5kdc[3165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317544, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.235.129@KRBTEST.COM
I20260809 23:19:05.276161 3769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.265911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34220 (local address 127.1.235.129:45173)
0809 23:19:05.265942 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:05.265944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:05.266250 (+ 306us) server_negotiation.cc:407] Connection header received
0809 23:19:05.266276 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:05.266277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:05.266289 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:05.266348 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:05.267208 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.267903 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.268913 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.269170 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.269215 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.272836 (+ 3621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:05.272845 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:05.272845 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:05.272853 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:05.274868 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:05.275281 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:05.275284 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:05.275285 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:05.275351 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:05.275600 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:05.275601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:05.275601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:05.275773 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:05.275920 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:05.275990 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 23:19:05.276074 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
W20260809 23:19:05.276403 3434 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34220
I20260809 23:19:05.285300 3267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:05.278059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44062 (local address 127.1.235.190:37487)
0809 23:19:05.278106 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:05.278108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:05.278301 (+ 193us) server_negotiation.cc:407] Connection header received
0809 23:19:05.278348 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:05.278349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:05.278360 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:05.278432 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:05.279061 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.279837 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.280847 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:05.281158 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:05.281241 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:05.282555 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:05.282556 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:05.282557 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:05.282563 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:05.284138 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:05.284512 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:05.284513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:05.284514 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:05.284573 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:05.284783 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:05.284783 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:05.284784 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:05.284910 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:05.285003 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:05.285131 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 23:19:05.285216 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
W20260809 23:19:05.285714 3211 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44062
I20260809 23:19:05.286422 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 3293
I20260809 23:19:05.296610 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 3449
I20260809 23:19:05.304556 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 3602
I20260809 23:19:05.312147 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 3179
2026-08-09T23:19:05Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2210 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:19:05 dist-test-slave-6nmv krb5kdc[3842](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:19:05 dist-test-slave-6nmv krb5kdc[3842](info): set up 2 sockets
Aug 09 23:19:05 dist-test-slave-6nmv krb5kdc[3842](info): commencing operation
krb5kdc: starting...
W20260809 23:19:06.356416 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.021s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:19:06 dist-test-slave-6nmv krb5kdc[3842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:19:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:19:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:19:06.468978 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:40159
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:37811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:40159
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:06.545811 3858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:06.546066 3858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:06.546104 3858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:06.547246 3858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:06.547312 3858 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 23:19:06.547334 3858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:06.547355 3858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:06.547384 3858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:06.547400 3858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:19:06.548807 3858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:37811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:40159
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:40159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:06.549088 3858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:06.549312 3858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:06.554214 3866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:06.554221 3864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:06.554296 3863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:06.554427 3858 server_base.cc:1034] running on GCE node
I20260809 23:19:06.554663 3858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:06.554880 3858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:06.556030 3858 hybrid_clock.cc:648] HybridClock initialized: now 1786317546556008 us; error 36 us; skew 500 ppm
Aug 09 23:19:06 dist-test-slave-6nmv krb5kdc[3842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317546, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:06.558732 3858 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:19:06.559230 3858 webserver.cc:460] Webserver started at http://127.1.235.190:41793/ using document root <none> and password file <none>
I20260809 23:19:06.559476 3858 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:06.559542 3858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:06.559685 3858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:06.560714 3858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "21404a3d6d9449e7a3ca19e9f5a23dc4"
format_stamp: "Formatted at 2026-08-09 23:19:06 on dist-test-slave-6nmv"
server_key: "a5455df4b347742d1982eaff54652b1d"
server_key_iv: "38704e37a003254249840d3a427e618d"
server_key_version: "encryptionkey@0"
I20260809 23:19:06.561085 3858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "21404a3d6d9449e7a3ca19e9f5a23dc4"
format_stamp: "Formatted at 2026-08-09 23:19:06 on dist-test-slave-6nmv"
server_key: "a5455df4b347742d1982eaff54652b1d"
server_key_iv: "38704e37a003254249840d3a427e618d"
server_key_version: "encryptionkey@0"
I20260809 23:19:06.562469 3858 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:19:06.563241 3873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:06.563476 3858 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:06.563582 3858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "21404a3d6d9449e7a3ca19e9f5a23dc4"
format_stamp: "Formatted at 2026-08-09 23:19:06 on dist-test-slave-6nmv"
server_key: "a5455df4b347742d1982eaff54652b1d"
server_key_iv: "38704e37a003254249840d3a427e618d"
server_key_version: "encryptionkey@0"
I20260809 23:19:06.563652 3858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:06.584914 3858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:06.587083 3858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:06.587191 3858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:06.591833 3858 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:40159
I20260809 23:19:06.591958 3943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:40159 every 8 connection(s)
I20260809 23:19:06.592239 3858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:19:06.592878 3944 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:06.593917 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 3858
I20260809 23:19:06.593992 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:19:06.594141 1966 external_mini_cluster.cc:1428] Setting key 8f6f77de996d5e0733a8c0d57e4f0137
I20260809 23:19:06.595233 3944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4: Bootstrap starting.
I20260809 23:19:06.595801 3944 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:06.596107 3944 log.cc:824] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:06.596796 3944 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4: No bootstrap required, opened a new log
I20260809 23:19:06.598683 3944 raft_consensus.cc:348] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21404a3d6d9449e7a3ca19e9f5a23dc4" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40159 } }
I20260809 23:19:06.598872 3944 raft_consensus.cc:374] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:06.598923 3944 raft_consensus.cc:729] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21404a3d6d9449e7a3ca19e9f5a23dc4, State: Initialized, Role: FOLLOWER
I20260809 23:19:06.599087 3944 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21404a3d6d9449e7a3ca19e9f5a23dc4" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40159 } }
I20260809 23:19:06.599182 3944 raft_consensus.cc:388] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:19:06.599226 3944 raft_consensus.cc:482] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:19:06.599274 3944 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:06.599815 3944 raft_consensus.cc:504] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21404a3d6d9449e7a3ca19e9f5a23dc4" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40159 } }
I20260809 23:19:06.599926 3944 leader_election.cc:302] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21404a3d6d9449e7a3ca19e9f5a23dc4; no voters:
I20260809 23:19:06.600116 3944 leader_election.cc:288] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:19:06.600222 3949 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:06.600361 3944 sys_catalog.cc:564] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [sys.catalog]: configured and running, proceeding with master startup.
Aug 09 23:19:06 dist-test-slave-6nmv krb5kdc[3842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:06.600479 3949 raft_consensus.cc:686] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [term 1 LEADER]: Becoming Leader. State: Replica: 21404a3d6d9449e7a3ca19e9f5a23dc4, State: Running, Role: LEADER
I20260809 23:19:06.600690 3949 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21404a3d6d9449e7a3ca19e9f5a23dc4" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40159 } }
I20260809 23:19:06.601078 3949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21404a3d6d9449e7a3ca19e9f5a23dc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21404a3d6d9449e7a3ca19e9f5a23dc4" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40159 } } }
I20260809 23:19:06.601519 3949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:06.601747 3952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21404a3d6d9449e7a3ca19e9f5a23dc4. Latest consensus state: current_term: 1 leader_uuid: "21404a3d6d9449e7a3ca19e9f5a23dc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21404a3d6d9449e7a3ca19e9f5a23dc4" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40159 } } }
I20260809 23:19:06.602298 3952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4 [sys.catalog]: This master's current role is: LEADER
W20260809 23:19:06.602355 3966 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 23:19:06.602399 3966 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:19:06.602641 3969 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:19:06.602806 3969 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:19:06.605218 3969 catalog_manager.cc:1347] Generated new cluster ID: 24f0acb500f8474bb460bcbf4d163b05
I20260809 23:19:06.605271 3969 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:19:06.606065 3947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:06.594602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46856 (local address 127.1.235.190:40159)
0809 23:19:06.594801 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:06.594808 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:06.594829 (+ 21us) server_negotiation.cc:407] Connection header received
0809 23:19:06.595186 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:06.595192 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:06.595232 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:06.595369 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:06.596007 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.596980 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.597726 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.598211 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.598328 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:06.601055 (+ 2727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:06.601060 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:06.601060 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:06.601074 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:06.603479 (+ 2405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:06.604008 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:06.604011 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:06.604011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:06.604168 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:06.604469 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:06.604470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:06.604470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:06.604874 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:06.605599 (+ 725us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:06.605671 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 23:19:06.605829 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":94,"threads_started":1}
I20260809 23:19:06.629621 3969 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:19:06.630200 3969 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:19:06.634783 3969 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4: Generated new TSK 0
I20260809 23:19:06.634949 3969 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:19:06.662621 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:40159
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:37811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:06.770599 3973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:06.770771 3973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:06.770812 3973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:06.771917 3973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:06.771960 3973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:06.771979 3973 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 23:19:06.771991 3973 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 23:19:06.772006 3973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:19:06.773406 3973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:37811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.235.190:40159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:06.773622 3973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:06.773881 3973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:06.778503 3978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:06.778522 3979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:06.778528 3981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:06.778702 3973 server_base.cc:1034] running on GCE node
I20260809 23:19:06.778877 3973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:06.779116 3973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:06.780251 3973 hybrid_clock.cc:648] HybridClock initialized: now 1786317546780226 us; error 40 us; skew 500 ppm
Aug 09 23:19:06 dist-test-slave-6nmv krb5kdc[3842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317546, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:06.782723 3973 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:19:06.783099 3973 webserver.cc:460] Webserver started at http://127.1.235.129:39977/ using document root <none> and password file <none>
I20260809 23:19:06.783313 3973 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:06.783355 3973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:06.783557 3973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:06.784468 3973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "5937ef2ea23d4abe8c53957da06dbada"
format_stamp: "Formatted at 2026-08-09 23:19:06 on dist-test-slave-6nmv"
server_key: "90298f7cf8293c11cd38fdc2828d1dad"
server_key_iv: "b37c058f30487b950aed88b16c7bf30f"
server_key_version: "encryptionkey@0"
I20260809 23:19:06.784857 3973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "5937ef2ea23d4abe8c53957da06dbada"
format_stamp: "Formatted at 2026-08-09 23:19:06 on dist-test-slave-6nmv"
server_key: "90298f7cf8293c11cd38fdc2828d1dad"
server_key_iv: "b37c058f30487b950aed88b16c7bf30f"
server_key_version: "encryptionkey@0"
I20260809 23:19:06.786082 3973 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:19:06.786720 3988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:06.786881 3973 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:06.786962 3973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "5937ef2ea23d4abe8c53957da06dbada"
format_stamp: "Formatted at 2026-08-09 23:19:06 on dist-test-slave-6nmv"
server_key: "90298f7cf8293c11cd38fdc2828d1dad"
server_key_iv: "b37c058f30487b950aed88b16c7bf30f"
server_key_version: "encryptionkey@0"
I20260809 23:19:06.787027 3973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:06.806679 3973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:06.809190 3973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:06.809370 3973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:06.809967 3973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:06.810010 3973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:06.810032 3973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:06.810046 3973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:06.817484 3973 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:46455
I20260809 23:19:06.817538 4117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:46455 every 8 connection(s)
Aug 09 23:19:06 dist-test-slave-6nmv krb5kdc[3842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317546, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:06.817853 3973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:19:06.820640 3947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:06.810987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:59759 (local address 127.1.235.190:40159)
0809 23:19:06.811056 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:06.811058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:06.811292 (+ 234us) server_negotiation.cc:407] Connection header received
0809 23:19:06.812088 (+ 796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:06.812090 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:06.812104 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:06.812160 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:06.813067 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.813773 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.815298 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.815588 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.815639 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:06.818258 (+ 2619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:06.818260 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:06.818260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:06.818268 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:06.819521 (+ 1253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:06.819901 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:06.819902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:06.819902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:06.819972 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:06.820176 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:06.820177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:06.820177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:06.820270 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:06.820320 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:06.820516 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 23:19:06.820581 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 23:19:06.820801 3998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:06.810956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40159 (local address 127.1.235.129:59759)
0809 23:19:06.811147 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:06.811191 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:06.811955 (+ 764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:06.812261 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:06.812266 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:06.812644 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:06.812961 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:06.812968 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.813918 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.813919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:06.815178 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:06.815182 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.815672 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.815672 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:06.815819 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:06.816377 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:06.816387 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:06.818175 (+ 1788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:06.819596 (+ 1421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:06.819603 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:06.819604 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:06.819809 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:06.820043 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:06.820044 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:06.820044 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:06.820125 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:06.820321 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:06.820324 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:06.820429 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 23:19:06.820496 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 23:19:06.820603 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":99,"threads_started":1}
I20260809 23:19:06.821378 4118 heartbeater.cc:347] Connected to a master server at 127.1.235.190:40159
I20260809 23:19:06.821463 4118 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:06.821640 4118 heartbeater.cc:511] Master 127.1.235.190:40159 requested a full tablet report, sending...
I20260809 23:19:06.822192 3892 ts_manager.cc:194] Registered new tserver with Master: 5937ef2ea23d4abe8c53957da06dbada (127.1.235.129:46455)
I20260809 23:19:06.823064 3892 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:59759
I20260809 23:19:06.827368 4126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:06.822366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40159 (local address 127.1.235.129:48691)
0809 23:19:06.822484 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:06.822493 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:06.822543 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:06.822666 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:06.822667 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:06.822829 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:06.822876 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:06.822877 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.823673 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.823673 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:06.824135 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:06.824137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.824453 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.824454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:06.824499 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:06.824796 (+ 297us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:06.824800 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:06.825014 (+ 214us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:06.826640 (+ 1626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:06.826641 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:06.826641 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:06.826791 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:06.826972 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:06.826972 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:06.826973 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:06.827022 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:06.827180 (+ 158us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:06.827180 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:06.827210 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 23:19:06.827255 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 23:19:06.827314 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":60,"threads_started":1}
I20260809 23:19:06.827389 3947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:06.822445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:48691 (local address 127.1.235.190:40159)
0809 23:19:06.822478 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:06.822480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:06.822538 (+ 58us) server_negotiation.cc:407] Connection header received
0809 23:19:06.822593 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:06.822594 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:06.822601 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:06.822649 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:06.822960 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.823539 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.824205 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.824382 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.824437 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:06.825096 (+ 659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:06.825097 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:06.825097 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:06.825102 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:06.826568 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:06.826854 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:06.826855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:06.826855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:06.826919 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:06.827057 (+ 138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:06.827057 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:06.827057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:06.827134 (+ 77us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:06.827180 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:06.827271 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 23:19:06.827327 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 23:19:06.827855 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 3973
I20260809 23:19:06.827967 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:19:06.828181 1966 external_mini_cluster.cc:1428] Setting key ba03a556d203163be712d7e8a8a73787
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:19:06.850360 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:40159
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:37811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:06.926074 4129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:06.926281 4129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:06.926304 4129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:06.927318 4129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:06.927356 4129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:06.927376 4129 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 23:19:06.927388 4129 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 23:19:06.927403 4129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:19:06.928618 4129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:37811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.235.190:40159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:06.928773 4129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:06.928956 4129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:06.933360 4134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:06.933413 4138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:06.933379 4136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:06.933393 4129 server_base.cc:1034] running on GCE node
I20260809 23:19:06.933616 4129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:06.933784 4129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:06.934950 4129 hybrid_clock.cc:648] HybridClock initialized: now 1786317546934936 us; error 29 us; skew 500 ppm
Aug 09 23:19:06 dist-test-slave-6nmv krb5kdc[3842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317546, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:06.937146 4129 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:19:06.937556 4129 webserver.cc:460] Webserver started at http://127.1.235.130:40923/ using document root <none> and password file <none>
I20260809 23:19:06.937753 4129 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:06.937813 4129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:06.937979 4129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:06.938889 4129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "2816a3ea70d843819e43a98d84605b68"
format_stamp: "Formatted at 2026-08-09 23:19:06 on dist-test-slave-6nmv"
server_key: "2d060fb60f150b1ae35f19fb89900431"
server_key_iv: "fbaf2e359df4e34233d4ef6ed9cf2efb"
server_key_version: "encryptionkey@0"
I20260809 23:19:06.939249 4129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "2816a3ea70d843819e43a98d84605b68"
format_stamp: "Formatted at 2026-08-09 23:19:06 on dist-test-slave-6nmv"
server_key: "2d060fb60f150b1ae35f19fb89900431"
server_key_iv: "fbaf2e359df4e34233d4ef6ed9cf2efb"
server_key_version: "encryptionkey@0"
I20260809 23:19:06.940546 4129 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 23:19:06.941213 4146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:06.941370 4129 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:06.941463 4129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "2816a3ea70d843819e43a98d84605b68"
format_stamp: "Formatted at 2026-08-09 23:19:06 on dist-test-slave-6nmv"
server_key: "2d060fb60f150b1ae35f19fb89900431"
server_key_iv: "fbaf2e359df4e34233d4ef6ed9cf2efb"
server_key_version: "encryptionkey@0"
I20260809 23:19:06.941547 4129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:06.953361 4129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:06.954970 4129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:06.955121 4129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:06.955626 4129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:06.955682 4129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:06.955716 4129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:06.955737 4129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 23:19:06 dist-test-slave-6nmv krb5kdc[3842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317546, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:06.962808 4129 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:36237
I20260809 23:19:06.962889 4269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:36237 every 8 connection(s)
I20260809 23:19:06.963155 4129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:19:06.964550 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 4129
I20260809 23:19:06.964653 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:19:06.964812 1966 external_mini_cluster.cc:1428] Setting key 072c259c253f2130c97533d1a3ba2e1b
I20260809 23:19:06.965250 3947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:06.955993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:40507 (local address 127.1.235.190:40159)
0809 23:19:06.956069 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:06.956071 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:06.956225 (+ 154us) server_negotiation.cc:407] Connection header received
0809 23:19:06.956578 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:06.956580 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:06.956594 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:06.956659 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:06.957250 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.958118 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.959248 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.959463 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.959555 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:06.962486 (+ 2931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:06.962488 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:06.962488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:06.962495 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:06.963889 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:06.964259 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:06.964260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:06.964261 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:06.964349 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:06.964597 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:06.964597 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:06.964598 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:06.964739 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:06.964810 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:06.965079 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 23:19:06.965167 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 23:19:06.965417 4155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:06.955971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40159 (local address 127.1.235.130:40507)
0809 23:19:06.956111 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:06.956143 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:06.956496 (+ 353us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:06.956726 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:06.956728 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:06.956926 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:06.957106 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:06.957111 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.958213 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.958214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:06.959157 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:06.959160 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.959566 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.959567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:06.959699 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:06.960197 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:06.960207 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:06.962389 (+ 2182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:06.963980 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:06.963986 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:06.963988 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:06.964188 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:06.964423 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:06.964424 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:06.964424 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:06.964528 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:06.964813 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:06.964820 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:06.964965 (+ 145us) client_negotiation.cc:769] Sending connection context
0809 23:19:06.965058 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 23:19:06.965207 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":85,"threads_started":1}
I20260809 23:19:06.965890 4271 heartbeater.cc:347] Connected to a master server at 127.1.235.190:40159
I20260809 23:19:06.965960 4271 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:06.966125 4271 heartbeater.cc:511] Master 127.1.235.190:40159 requested a full tablet report, sending...
I20260809 23:19:06.966446 3891 ts_manager.cc:194] Registered new tserver with Master: 2816a3ea70d843819e43a98d84605b68 (127.1.235.130:36237)
I20260809 23:19:06.966917 3891 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:40507
I20260809 23:19:06.972265 3947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:06.966837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:33617 (local address 127.1.235.190:40159)
0809 23:19:06.966869 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:06.966871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:06.966990 (+ 119us) server_negotiation.cc:407] Connection header received
0809 23:19:06.967070 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:06.967071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:06.967081 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:06.967140 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:06.967552 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.968018 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.968717 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.968933 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.969015 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:06.969909 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:06.969910 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:06.969910 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:06.969918 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:06.971118 (+ 1200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:06.971473 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:06.971474 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:06.971474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:06.971527 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:06.971752 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:06.971753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:06.971754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:06.971889 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:06.971964 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:06.972114 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 23:19:06.972180 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 23:19:06.972281 4277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:06.966801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40159 (local address 127.1.235.130:33617)
0809 23:19:06.966919 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:06.966927 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:06.967002 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:06.967200 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:06.967201 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:06.967401 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:06.967473 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:06.967475 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.968113 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.968114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:06.968619 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:06.968621 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:06.969018 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:06.969019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:06.969098 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:06.969516 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:06.969520 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:06.969768 (+ 248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:06.971213 (+ 1445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:06.971215 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:06.971215 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:06.971377 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:06.971590 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:06.971591 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:06.971591 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:06.971682 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:06.971955 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:06.971956 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:06.972000 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 23:19:06.972087 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 23:19:06.972182 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":69,"threads_started":1}
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:19:06.990087 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:40159
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:37811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:07.063503 4280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:07.063719 4280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:07.063758 4280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:07.064814 4280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:07.064875 4280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:07.064916 4280 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 23:19:07.064940 4280 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 23:19:07.064970 4280 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:19:07.066504 4280 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:37811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.235.190:40159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4280
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:07.066831 4280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:07.067049 4280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:07.071803 4288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:07.071815 4290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:07.071879 4280 server_base.cc:1034] running on GCE node
W20260809 23:19:07.071833 4287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:07.072155 4280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:07.072381 4280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:07.073527 4280 hybrid_clock.cc:648] HybridClock initialized: now 1786317547073516 us; error 24 us; skew 500 ppm
Aug 09 23:19:07 dist-test-slave-6nmv krb5kdc[3842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317547, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:07.075941 4280 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:19:07.076346 4280 webserver.cc:460] Webserver started at http://127.1.235.131:41477/ using document root <none> and password file <none>
I20260809 23:19:07.076558 4280 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:07.076601 4280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:07.076745 4280 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:07.077674 4280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "ad5e403ea37a4ed6b75dcfd412efedee"
format_stamp: "Formatted at 2026-08-09 23:19:07 on dist-test-slave-6nmv"
server_key: "85f9fe024d79abb15240bf25a56d75ad"
server_key_iv: "fa2f299a08eb59a487e6cebaf1d8bc1e"
server_key_version: "encryptionkey@0"
I20260809 23:19:07.078032 4280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "ad5e403ea37a4ed6b75dcfd412efedee"
format_stamp: "Formatted at 2026-08-09 23:19:07 on dist-test-slave-6nmv"
server_key: "85f9fe024d79abb15240bf25a56d75ad"
server_key_iv: "fa2f299a08eb59a487e6cebaf1d8bc1e"
server_key_version: "encryptionkey@0"
I20260809 23:19:07.079321 4280 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:19:07.079967 4297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:07.080135 4280 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:19:07.080232 4280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "ad5e403ea37a4ed6b75dcfd412efedee"
format_stamp: "Formatted at 2026-08-09 23:19:07 on dist-test-slave-6nmv"
server_key: "85f9fe024d79abb15240bf25a56d75ad"
server_key_iv: "fa2f299a08eb59a487e6cebaf1d8bc1e"
server_key_version: "encryptionkey@0"
I20260809 23:19:07.080310 4280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:07.114399 4280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:07.116071 4280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:07.116227 4280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:07.116693 4280 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:07.116753 4280 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:07.116797 4280 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:07.116825 4280 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 23:19:07 dist-test-slave-6nmv krb5kdc[3842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317547, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:07.123646 4280 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:38999
I20260809 23:19:07.123957 4280 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:19:07.124092 4424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:38999 every 8 connection(s)
I20260809 23:19:07.124444 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 4280
I20260809 23:19:07.124543 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:19:07.124744 1966 external_mini_cluster.cc:1428] Setting key afd3d4286753819b786a950f8f475f87
I20260809 23:19:07.127058 3947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.117224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:56661 (local address 127.1.235.190:40159)
0809 23:19:07.117296 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.117298 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.117499 (+ 201us) server_negotiation.cc:407] Connection header received
0809 23:19:07.118086 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.118088 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.118102 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.118161 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:07.118707 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.119581 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.121022 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.121353 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.121424 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.124017 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:07.124019 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:07.124019 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:07.124026 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:07.125771 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:07.126164 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:07.126165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:07.126165 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:07.126229 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:07.126474 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:07.126475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:07.126475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:07.126588 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:07.126658 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.126900 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.126974 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 23:19:07.127242 4306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.117210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40159 (local address 127.1.235.131:56661)
0809 23:19:07.117369 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:07.117407 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:07.117972 (+ 565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:07.118255 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:07.118258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:07.118464 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:07.118638 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.118641 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.119692 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.119693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.120940 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.120943 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.121467 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.121468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.121620 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.122492 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:07.122499 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:07.123929 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:07.125872 (+ 1943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:07.125879 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:07.125880 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:07.126091 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:07.126303 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:07.126304 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:07.126304 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:07.126407 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:07.126649 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:07.126655 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:07.126781 (+ 126us) client_negotiation.cc:769] Sending connection context
0809 23:19:07.126880 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 23:19:07.127028 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":93,"threads_started":1}
I20260809 23:19:07.127692 4425 heartbeater.cc:347] Connected to a master server at 127.1.235.190:40159
I20260809 23:19:07.127764 4425 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:07.127928 4425 heartbeater.cc:511] Master 127.1.235.190:40159 requested a full tablet report, sending...
I20260809 23:19:07.128263 3891 ts_manager.cc:194] Registered new tserver with Master: ad5e403ea37a4ed6b75dcfd412efedee (127.1.235.131:38999)
I20260809 23:19:07.128702 3891 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:56661
I20260809 23:19:07.133630 3947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.128672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:60197 (local address 127.1.235.190:40159)
0809 23:19:07.128710 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.128711 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.128775 (+ 64us) server_negotiation.cc:407] Connection header received
0809 23:19:07.128893 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.128894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.128906 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.128963 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:07.129269 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.129723 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.130470 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.130679 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.130757 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.131458 (+ 701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:07.131459 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:07.131459 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:07.131466 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:07.132514 (+ 1048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:07.132854 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:07.132855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:07.132855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:07.132908 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:07.133127 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:07.133128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:07.133128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:07.133243 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:07.133309 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.133474 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.133533 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 23:19:07.133630 4432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.128584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40159 (local address 127.1.235.131:60197)
0809 23:19:07.128727 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:07.128735 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:07.128806 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:07.128984 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:07.128984 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:07.129137 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:07.129189 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.129191 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.129858 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.129859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.130386 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.130387 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.130760 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.130761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.130835 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.131143 (+ 308us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:07.131146 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:07.131377 (+ 231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:07.132597 (+ 1220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:07.132598 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:07.132598 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:07.132769 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:07.132982 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:07.132983 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:07.132984 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:07.133041 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:07.133312 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:07.133313 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:07.133354 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 23:19:07.133427 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 23:19:07.133527 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":82,"threads_started":1}
I20260809 23:19:07.136170 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 23:19:07 dist-test-slave-6nmv krb5kdc[3842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 23:19:07 dist-test-slave-6nmv krb5kdc[3842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317547, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:07.156895 3947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.150911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46866 (local address 127.1.235.190:40159)
0809 23:19:07.150961 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.150965 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.150976 (+ 11us) server_negotiation.cc:407] Connection header received
0809 23:19:07.150993 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.150993 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.151000 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.151051 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:07.151537 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.151992 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.152652 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.152822 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.152876 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.154866 (+ 1990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:07.154867 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:07.154867 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:07.154873 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:07.156160 (+ 1287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:07.156411 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:07.156412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:07.156412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:07.156456 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:07.156586 (+ 130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:07.156586 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:07.156586 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:07.156659 (+ 73us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:07.156721 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.156796 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.156844 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 23:19:07.158375 3891 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:19:07.159919 3891 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:19:07.166790 4449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.162562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60760 (local address 127.1.235.130:36237)
0809 23:19:07.162741 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.162745 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.163045 (+ 300us) server_negotiation.cc:407] Connection header received
0809 23:19:07.163093 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.163095 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.163113 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.163187 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:07.163389 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.164442 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.165857 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.166373 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.166440 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.166490 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.166645 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.166680 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":97,"threads_started":1}
I20260809 23:19:07.166806 4445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.162327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:36237 (local address 127.0.0.1:60760)
0809 23:19:07.162933 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:07.162941 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:07.162986 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:07.163255 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:07.163256 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:07.163258 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:07.163302 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.163303 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.164499 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.164500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.165690 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.165692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.166440 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.166442 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.166517 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.166530 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 23:19:07.166607 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 23:19:07.166663 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"mutex_wait_us":56,"thread_start_us":93,"threads_started":1}
I20260809 23:19:07.166821 4444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.162264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:46455 (local address 127.0.0.1:38042)
0809 23:19:07.162459 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:07.162498 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:07.162561 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:07.163568 (+ 1007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:07.163568 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:07.163570 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:07.163604 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.163605 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.164458 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.164459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.165686 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.165689 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.166566 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.166566 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.166617 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.166620 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:19:07.166662 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 23:19:07.166690 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":101,"thread_start_us":59,"threads_started":1}
I20260809 23:19:07.167166 4446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.162304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:38999 (local address 127.0.0.1:39072)
0809 23:19:07.162755 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:07.162764 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:07.162815 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:07.163043 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:07.163045 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:07.163048 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:07.163108 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.163109 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.164479 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.164480 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.165492 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.165495 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.166478 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.166480 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.166590 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.166594 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:19:07.166639 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 23:19:07.166681 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"mutex_wait_us":2,"thread_start_us":101,"threads_started":1}
I20260809 23:19:07.167163 4447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.162379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38042 (local address 127.1.235.129:46455)
0809 23:19:07.163424 (+ 1045us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.163428 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.163436 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:19:07.163464 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.163465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.163476 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.163556 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:07.163658 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.164347 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.165756 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.166433 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.166492 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.166537 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.166998 (+ 461us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.167054 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1011,"thread_start_us":88,"threads_started":1}
I20260809 23:19:07.167352 4448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.162546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39072 (local address 127.1.235.131:38999)
0809 23:19:07.162733 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.162738 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.162808 (+ 70us) server_negotiation.cc:407] Connection header received
0809 23:19:07.162925 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.162927 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.162942 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.163023 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:07.163196 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.164375 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.165556 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.166303 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.166388 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.166443 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.166795 (+ 352us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.167023 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":93,"threads_started":1}
I20260809 23:19:07.167521 4197 tablet_service.cc:1467] Processing CreateTablet for tablet 6a4c6009ef564b9ab2f5b813f5aef4ba (DEFAULT_TABLE table=test-table [id=e7f3133255f7481189ecade6f4ae21c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:07.167894 4044 tablet_service.cc:1467] Processing CreateTablet for tablet 6a4c6009ef564b9ab2f5b813f5aef4ba (DEFAULT_TABLE table=test-table [id=e7f3133255f7481189ecade6f4ae21c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:07.168118 4197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a4c6009ef564b9ab2f5b813f5aef4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:07.168268 4044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a4c6009ef564b9ab2f5b813f5aef4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:07.168251 4352 tablet_service.cc:1467] Processing CreateTablet for tablet 6a4c6009ef564b9ab2f5b813f5aef4ba (DEFAULT_TABLE table=test-table [id=e7f3133255f7481189ecade6f4ae21c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:07.168581 4352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a4c6009ef564b9ab2f5b813f5aef4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:07.171190 4450 tablet_bootstrap.cc:492] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68: Bootstrap starting.
I20260809 23:19:07.171743 4452 tablet_bootstrap.cc:492] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee: Bootstrap starting.
I20260809 23:19:07.171968 4450 tablet_bootstrap.cc:654] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:07.171990 4454 tablet_bootstrap.cc:492] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada: Bootstrap starting.
I20260809 23:19:07.172385 4450 log.cc:824] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:07.172567 4454 tablet_bootstrap.cc:654] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:07.172643 4452 tablet_bootstrap.cc:654] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:07.172904 4454 log.cc:824] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:07.173008 4452 log.cc:824] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:07.173292 4450 tablet_bootstrap.cc:492] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68: No bootstrap required, opened a new log
I20260809 23:19:07.173386 4450 ts_tablet_manager.cc:1397] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:19:07.173610 4454 tablet_bootstrap.cc:492] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada: No bootstrap required, opened a new log
I20260809 23:19:07.173620 4452 tablet_bootstrap.cc:492] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee: No bootstrap required, opened a new log
I20260809 23:19:07.173676 4452 ts_tablet_manager.cc:1397] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:19:07.173676 4454 ts_tablet_manager.cc:1397] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:19:07.174793 4450 raft_consensus.cc:348] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } }
I20260809 23:19:07.174939 4450 raft_consensus.cc:374] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:07.174983 4450 raft_consensus.cc:729] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2816a3ea70d843819e43a98d84605b68, State: Initialized, Role: FOLLOWER
I20260809 23:19:07.175109 4450 consensus_queue.cc:260] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } }
I20260809 23:19:07.175431 4450 ts_tablet_manager.cc:1428] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:19:07.175539 4271 heartbeater.cc:503] Master 127.1.235.190:40159 was elected leader, sending a full tablet report...
I20260809 23:19:07.175472 4452 raft_consensus.cc:348] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } }
I20260809 23:19:07.175472 4454 raft_consensus.cc:348] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } }
I20260809 23:19:07.175621 4452 raft_consensus.cc:374] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:07.175621 4454 raft_consensus.cc:374] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:07.175670 4452 raft_consensus.cc:729] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5e403ea37a4ed6b75dcfd412efedee, State: Initialized, Role: FOLLOWER
I20260809 23:19:07.175670 4454 raft_consensus.cc:729] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5937ef2ea23d4abe8c53957da06dbada, State: Initialized, Role: FOLLOWER
I20260809 23:19:07.175787 4452 consensus_queue.cc:260] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } }
I20260809 23:19:07.175787 4454 consensus_queue.cc:260] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } }
I20260809 23:19:07.176033 4454 ts_tablet_manager.cc:1428] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 23:19:07.176043 4452 ts_tablet_manager.cc:1428] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 23:19:07.176188 4425 heartbeater.cc:503] Master 127.1.235.190:40159 was elected leader, sending a full tablet report...
I20260809 23:19:07.176195 4118 heartbeater.cc:503] Master 127.1.235.190:40159 was elected leader, sending a full tablet report...
W20260809 23:19:07.213882 4272 tablet.cc:2369] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 23:19:07.318691 4119 tablet.cc:2369] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:19:07.324476 4459 raft_consensus.cc:482] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:19:07.324600 4459 raft_consensus.cc:504] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } }
I20260809 23:19:07.324976 4459 leader_election.cc:288] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad5e403ea37a4ed6b75dcfd412efedee (127.1.235.131:38999), 2816a3ea70d843819e43a98d84605b68 (127.1.235.130:36237)
I20260809 23:19:07.329111 4449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.325242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:40881 (local address 127.1.235.130:36237)
0809 23:19:07.325288 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.325290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.325369 (+ 79us) server_negotiation.cc:407] Connection header received
0809 23:19:07.325475 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.325476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.325485 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.325545 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:07.325754 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.326536 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.328132 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.328704 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.328793 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.328802 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.328996 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.329043 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:19:07.329111 4448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.325320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:42381 (local address 127.1.235.131:38999)
0809 23:19:07.325385 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.325387 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.325401 (+ 14us) server_negotiation.cc:407] Connection header received
0809 23:19:07.325467 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.325468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.325477 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.325548 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:07.325754 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.326551 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.328131 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.328704 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.328793 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.328802 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.328997 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.329037 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 23:19:07.329152 4461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.325155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:36237 (local address 127.1.235.129:40881)
0809 23:19:07.325302 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:07.325312 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:07.325397 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:07.325585 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:07.325586 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:07.325598 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:07.325673 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.325676 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.326628 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.326629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.328032 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.328035 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.328847 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.328847 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.328913 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.328920 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 23:19:07.328981 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 23:19:07.329042 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":66,"thread_start_us":81,"threads_started":1}
I20260809 23:19:07.329267 4462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.325233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:38999 (local address 127.1.235.129:42381)
0809 23:19:07.325341 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:07.325349 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:07.325397 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:07.325586 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:07.325586 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:07.325588 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:07.325674 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.325676 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.326625 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.326626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.328032 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.328035 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.328832 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.328834 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.328913 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.328922 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 23:19:07.328981 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 23:19:07.329042 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"mutex_wait_us":85,"thread_start_us":49,"threads_started":1}
I20260809 23:19:07.329598 4219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a4c6009ef564b9ab2f5b813f5aef4ba" candidate_uuid: "5937ef2ea23d4abe8c53957da06dbada" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2816a3ea70d843819e43a98d84605b68" is_pre_election: true
I20260809 23:19:07.329602 4373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a4c6009ef564b9ab2f5b813f5aef4ba" candidate_uuid: "5937ef2ea23d4abe8c53957da06dbada" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" is_pre_election: true
I20260809 23:19:07.329752 4219 raft_consensus.cc:2454] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5937ef2ea23d4abe8c53957da06dbada in term 0.
I20260809 23:19:07.329769 4373 raft_consensus.cc:2454] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5937ef2ea23d4abe8c53957da06dbada in term 0.
I20260809 23:19:07.330042 3991 leader_election.cc:302] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5937ef2ea23d4abe8c53957da06dbada, ad5e403ea37a4ed6b75dcfd412efedee; no voters:
I20260809 23:19:07.330231 4459 raft_consensus.cc:2781] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:19:07.330269 4459 raft_consensus.cc:482] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:19:07.330283 4459 raft_consensus.cc:3037] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:07.330953 4459 raft_consensus.cc:504] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } }
I20260809 23:19:07.331089 4459 leader_election.cc:288] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [CANDIDATE]: Term 1 election: Requested vote from peers ad5e403ea37a4ed6b75dcfd412efedee (127.1.235.131:38999), 2816a3ea70d843819e43a98d84605b68 (127.1.235.130:36237)
I20260809 23:19:07.331226 4219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a4c6009ef564b9ab2f5b813f5aef4ba" candidate_uuid: "5937ef2ea23d4abe8c53957da06dbada" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2816a3ea70d843819e43a98d84605b68"
I20260809 23:19:07.331233 4373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a4c6009ef564b9ab2f5b813f5aef4ba" candidate_uuid: "5937ef2ea23d4abe8c53957da06dbada" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5e403ea37a4ed6b75dcfd412efedee"
I20260809 23:19:07.331295 4219 raft_consensus.cc:3037] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:07.331318 4373 raft_consensus.cc:3037] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:07.331985 4219 raft_consensus.cc:2454] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5937ef2ea23d4abe8c53957da06dbada in term 1.
I20260809 23:19:07.332101 4373 raft_consensus.cc:2454] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5937ef2ea23d4abe8c53957da06dbada in term 1.
I20260809 23:19:07.332165 3990 leader_election.cc:302] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2816a3ea70d843819e43a98d84605b68, 5937ef2ea23d4abe8c53957da06dbada; no voters:
I20260809 23:19:07.332254 4459 raft_consensus.cc:2781] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:07.332368 4459 raft_consensus.cc:686] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [term 1 LEADER]: Becoming Leader. State: Replica: 5937ef2ea23d4abe8c53957da06dbada, State: Running, Role: LEADER
I20260809 23:19:07.332458 4459 consensus_queue.cc:237] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } }
I20260809 23:19:07.333223 3892 catalog_manager.cc:5495] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada reported cstate change: term changed from 0 to 1, leader changed from <none> to 5937ef2ea23d4abe8c53957da06dbada (127.1.235.129). New cstate: current_term: 1 leader_uuid: "5937ef2ea23d4abe8c53957da06dbada" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } health_report { overall_health: UNKNOWN } } }
Aug 09 23:19:07 dist-test-slave-6nmv krb5kdc[3842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317546, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:07.369381 4470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.362542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40159 (local address 127.0.0.1:46868)
0809 23:19:07.362735 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:07.362745 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:07.362822 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:07.362964 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:07.362964 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:07.363279 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:07.363325 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.363327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.364000 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.364001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.364514 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.364515 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.364880 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.364881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.364947 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.365479 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:07.365484 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:07.367008 (+ 1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:07.368472 (+ 1464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:07.368477 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:07.368479 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:07.368664 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:07.368844 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:07.368844 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:07.368845 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:07.368917 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:07.369122 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:07.369128 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:07.369167 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 23:19:07.369218 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 23:19:07.369306 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":102,"threads_started":1}
I20260809 23:19:07.369431 3947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.362608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46868 (local address 127.1.235.190:40159)
0809 23:19:07.362702 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.362704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.362803 (+ 99us) server_negotiation.cc:407] Connection header received
0809 23:19:07.362890 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.362890 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.362901 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.362956 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:07.363414 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.363919 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.364613 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.364795 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.364883 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.367083 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:07.367084 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:07.367085 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:07.367104 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:07.368409 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:07.368725 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:07.368725 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:07.368726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:07.368772 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:07.368969 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:07.368969 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:07.368969 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:07.369070 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:07.369120 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.369236 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.369348 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":67}
I20260809 23:19:07.371212 3892 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:46868:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 23:19:07.371420 3892 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:19:07.372789 4044 tablet_service.cc:1467] Processing CreateTablet for tablet 5d428629746b4dc5a7a356b27f8a3a17 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f38d38145e954b5696527b6931f24789]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 23:19:07.372812 4197 tablet_service.cc:1467] Processing CreateTablet for tablet 5d428629746b4dc5a7a356b27f8a3a17 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f38d38145e954b5696527b6931f24789]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 23:19:07.372917 4352 tablet_service.cc:1467] Processing CreateTablet for tablet 5d428629746b4dc5a7a356b27f8a3a17 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f38d38145e954b5696527b6931f24789]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 23:19:07.372978 4044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d428629746b4dc5a7a356b27f8a3a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:07.372979 4197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d428629746b4dc5a7a356b27f8a3a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:07.373052 4352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d428629746b4dc5a7a356b27f8a3a17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:07.374078 4454 tablet_bootstrap.cc:492] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada: Bootstrap starting.
W20260809 23:19:07.374495 4426 tablet.cc:2369] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:19:07.374524 4454 tablet_bootstrap.cc:654] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:07.374730 4452 tablet_bootstrap.cc:492] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee: Bootstrap starting.
I20260809 23:19:07.375245 4452 tablet_bootstrap.cc:654] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:07.375532 4454 tablet_bootstrap.cc:492] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada: No bootstrap required, opened a new log
I20260809 23:19:07.375582 4454 ts_tablet_manager.cc:1397] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:19:07.375594 4450 tablet_bootstrap.cc:492] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68: Bootstrap starting.
I20260809 23:19:07.375730 4454 raft_consensus.cc:348] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.375801 4454 raft_consensus.cc:374] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:07.375818 4454 raft_consensus.cc:729] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5937ef2ea23d4abe8c53957da06dbada, State: Initialized, Role: FOLLOWER
I20260809 23:19:07.375871 4454 consensus_queue.cc:260] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.375900 4452 tablet_bootstrap.cc:492] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee: No bootstrap required, opened a new log
I20260809 23:19:07.375941 4452 ts_tablet_manager.cc:1397] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:07.375964 4454 ts_tablet_manager.cc:1428] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:07.376005 4459 tablet_replica.cc:439] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } }
I20260809 23:19:07.376097 4459 tablet_replica.cc:442] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:19:07.376075 4452 raft_consensus.cc:348] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.376178 4452 raft_consensus.cc:374] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:07.376195 4450 tablet_bootstrap.cc:654] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:07.376212 4452 raft_consensus.cc:729] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5e403ea37a4ed6b75dcfd412efedee, State: Initialized, Role: FOLLOWER
I20260809 23:19:07.376257 4452 consensus_queue.cc:260] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.376338 4452 ts_tablet_manager.cc:1428] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:07.376412 4460 tablet_replica.cc:439] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } }
I20260809 23:19:07.376505 4460 tablet_replica.cc:442] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:19:07.376880 4450 tablet_bootstrap.cc:492] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68: No bootstrap required, opened a new log
I20260809 23:19:07.376927 4450 ts_tablet_manager.cc:1397] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:07.377068 4450 raft_consensus.cc:348] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.377179 4450 raft_consensus.cc:374] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:07.377210 4450 raft_consensus.cc:729] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2816a3ea70d843819e43a98d84605b68, State: Initialized, Role: FOLLOWER
I20260809 23:19:07.377257 4450 consensus_queue.cc:260] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.377349 4450 ts_tablet_manager.cc:1428] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:07.377399 4458 tablet_replica.cc:439] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } }
I20260809 23:19:07.377494 4458 tablet_replica.cc:442] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:19:07.676041 4460 raft_consensus.cc:482] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:19:07.676133 4460 raft_consensus.cc:504] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.676489 4460 leader_election.cc:288] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5937ef2ea23d4abe8c53957da06dbada (127.1.235.129:46455), 2816a3ea70d843819e43a98d84605b68 (127.1.235.130:36237)
I20260809 23:19:07.680140 4449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.676748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:47785 (local address 127.1.235.130:36237)
0809 23:19:07.676790 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.676792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.676860 (+ 68us) server_negotiation.cc:407] Connection header received
0809 23:19:07.676895 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.676896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.676905 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.676974 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:07.677166 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.677830 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.679203 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.679750 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.679825 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.679834 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.679994 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.680036 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 23:19:07.680141 4476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.676742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:44449 (local address 127.1.235.129:46455)
0809 23:19:07.676857 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.676859 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.676868 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:19:07.676895 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.676896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.676905 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.676974 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:07.677172 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.677830 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.679203 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.679750 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.679826 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.679834 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.679994 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.680038 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79,"thread_start_us":50,"threads_started":1}
I20260809 23:19:07.680166 4474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.676675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:46455 (local address 127.1.235.131:44449)
0809 23:19:07.676785 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:07.676796 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:07.676848 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:07.676991 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:07.676991 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:07.676994 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:07.677076 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.677079 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.677902 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.677903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.679112 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.679116 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.679835 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.679837 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.679912 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.679919 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 23:19:07.679976 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 23:19:07.680035 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":46,"thread_start_us":51,"threads_started":1}
I20260809 23:19:07.680166 4475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.676674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:36237 (local address 127.1.235.131:47785)
0809 23:19:07.676785 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:07.676796 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:07.676850 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:07.676991 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:07.676991 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:07.676995 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:07.677104 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.677105 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.677902 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.677902 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.679114 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.679115 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.679837 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.679837 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.679912 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.679919 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 23:19:07.679976 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 23:19:07.680035 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"mutex_wait_us":80,"thread_start_us":54,"threads_started":1}
I20260809 23:19:07.680600 4219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d428629746b4dc5a7a356b27f8a3a17" candidate_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2816a3ea70d843819e43a98d84605b68" is_pre_election: true
I20260809 23:19:07.680605 4065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d428629746b4dc5a7a356b27f8a3a17" candidate_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5937ef2ea23d4abe8c53957da06dbada" is_pre_election: true
I20260809 23:19:07.680698 4219 raft_consensus.cc:2454] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5e403ea37a4ed6b75dcfd412efedee in term 0.
I20260809 23:19:07.680712 4065 raft_consensus.cc:2454] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5e403ea37a4ed6b75dcfd412efedee in term 0.
I20260809 23:19:07.680912 4298 leader_election.cc:302] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5937ef2ea23d4abe8c53957da06dbada, ad5e403ea37a4ed6b75dcfd412efedee; no voters:
I20260809 23:19:07.681104 4460 raft_consensus.cc:2781] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:19:07.681154 4460 raft_consensus.cc:482] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:19:07.681173 4460 raft_consensus.cc:3037] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:07.681897 4460 raft_consensus.cc:504] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.682026 4460 leader_election.cc:288] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [CANDIDATE]: Term 1 election: Requested vote from peers 5937ef2ea23d4abe8c53957da06dbada (127.1.235.129:46455), 2816a3ea70d843819e43a98d84605b68 (127.1.235.130:36237)
I20260809 23:19:07.682196 4219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d428629746b4dc5a7a356b27f8a3a17" candidate_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2816a3ea70d843819e43a98d84605b68"
I20260809 23:19:07.682195 4065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d428629746b4dc5a7a356b27f8a3a17" candidate_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5937ef2ea23d4abe8c53957da06dbada"
I20260809 23:19:07.682269 4219 raft_consensus.cc:3037] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:07.682298 4065 raft_consensus.cc:3037] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:07.682979 4219 raft_consensus.cc:2454] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5e403ea37a4ed6b75dcfd412efedee in term 1.
I20260809 23:19:07.683089 4065 raft_consensus.cc:2454] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5e403ea37a4ed6b75dcfd412efedee in term 1.
I20260809 23:19:07.683193 4299 leader_election.cc:302] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2816a3ea70d843819e43a98d84605b68, ad5e403ea37a4ed6b75dcfd412efedee; no voters:
I20260809 23:19:07.683285 4460 raft_consensus.cc:2781] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:07.683398 4460 raft_consensus.cc:686] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [term 1 LEADER]: Becoming Leader. State: Replica: ad5e403ea37a4ed6b75dcfd412efedee, State: Running, Role: LEADER
I20260809 23:19:07.683511 4460 consensus_queue.cc:237] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.684016 4477 tablet_replica.cc:439] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee: TxnStatusTablet state changed. Reason: New leader ad5e403ea37a4ed6b75dcfd412efedee. Latest consensus state: current_term: 1 leader_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } }
I20260809 23:19:07.684118 4477 tablet_replica.cc:442] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee: This TxnStatusTablet replica's current role is: LEADER
I20260809 23:19:07.684343 4479 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 23:19:07.684448 4479 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 23:19:07.684391 3892 catalog_manager.cc:5495] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee reported cstate change: term changed from 0 to 1, leader changed from <none> to ad5e403ea37a4ed6b75dcfd412efedee (127.1.235.131). New cstate: current_term: 1 leader_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } health_report { overall_health: HEALTHY } } }
I20260809 23:19:07.730363 4470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.727479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:38999 (local address 127.0.0.1:39080)
0809 23:19:07.727560 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:07.727574 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:07.727642 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:07.727831 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:07.727832 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:07.727833 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 23:19:07.727879 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.727881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.728761 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.728761 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.729399 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.729401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.729892 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.729893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.729950 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.729964 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 23:19:07.730239 (+ 275us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 23:19:07.730245 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 23:19:07.730278 (+ 33us) client_negotiation.cc:240] Negotiation successful
0809 23:19:07.730311 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 23:19:07.730373 4448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.727576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39080 (local address 127.1.235.131:38999)
0809 23:19:07.727646 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.727648 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.727659 (+ 11us) server_negotiation.cc:407] Connection header received
0809 23:19:07.727717 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.727718 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.727738 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.727820 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:19:07.727943 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.728686 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.729476 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.729777 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.729878 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.730066 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:19:07.730180 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:19:07.730251 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.730283 (+ 32us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.730304 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 23:19:07.731947 4065 raft_consensus.cc:1261] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada [term 1 FOLLOWER]: Refusing update from remote peer ad5e403ea37a4ed6b75dcfd412efedee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:07.732048 4219 raft_consensus.cc:1261] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68 [term 1 FOLLOWER]: Refusing update from remote peer ad5e403ea37a4ed6b75dcfd412efedee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:07.732229 4477 consensus_queue.cc:1035] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:07.732332 4460 consensus_queue.cc:1035] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee [LEADER]: Connected to new peer: Peer: permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:07.733450 4459 tablet_replica.cc:439] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada: TxnStatusTablet state changed. Reason: New leader ad5e403ea37a4ed6b75dcfd412efedee. Latest consensus state: current_term: 1 leader_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } }
I20260809 23:19:07.733451 4458 tablet_replica.cc:439] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68: TxnStatusTablet state changed. Reason: New leader ad5e403ea37a4ed6b75dcfd412efedee. Latest consensus state: current_term: 1 leader_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } }
I20260809 23:19:07.733534 4459 tablet_replica.cc:442] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:19:07.733534 4458 tablet_replica.cc:442] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:19:07.734581 4460 tablet_replica.cc:439] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } }
I20260809 23:19:07.734680 4460 tablet_replica.cc:442] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee: This TxnStatusTablet replica's current role is: LEADER
I20260809 23:19:07.734727 4460 tablet_replica.cc:439] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } }
I20260809 23:19:07.734725 4483 mvcc.cc:205] Tried to move back new op lower bound from 7316756675507638272 to 7316756675312492544. Current Snapshot: MvccSnapshot[applied={T|T < 7316756675507638272}]
I20260809 23:19:07.734764 4460 tablet_replica.cc:442] T 5d428629746b4dc5a7a356b27f8a3a17 P ad5e403ea37a4ed6b75dcfd412efedee: This TxnStatusTablet replica's current role is: LEADER
I20260809 23:19:07.734757 4459 tablet_replica.cc:439] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } }
I20260809 23:19:07.734829 4459 tablet_replica.cc:442] T 5d428629746b4dc5a7a356b27f8a3a17 P 5937ef2ea23d4abe8c53957da06dbada: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:19:07.734877 4458 tablet_replica.cc:439] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } } }
I20260809 23:19:07.734949 4458 tablet_replica.cc:442] T 5d428629746b4dc5a7a356b27f8a3a17 P 2816a3ea70d843819e43a98d84605b68: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:19:07.734963 4485 mvcc.cc:205] Tried to move back new op lower bound from 7316756675507638272 to 7316756675312492544. Current Snapshot: MvccSnapshot[applied={T|T < 7316756675507638272}]
I20260809 23:19:07.739315 4476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.736882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38044 (local address 127.1.235.129:46455)
0809 23:19:07.736918 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.736920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.737051 (+ 131us) server_negotiation.cc:407] Connection header received
0809 23:19:07.737095 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.737096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.737112 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.737185 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:19:07.737257 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.737906 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.738571 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.738820 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.738894 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.739036 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:19:07.739137 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:19:07.739205 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.739232 (+ 27us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.739252 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:19:07.744132 4448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.741526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:34899 (local address 127.1.235.131:38999)
0809 23:19:07.741565 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.741567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.741667 (+ 100us) server_negotiation.cc:407] Connection header received
0809 23:19:07.741691 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.741691 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.741700 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.741764 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:19:07.741903 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.742553 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.743381 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.743651 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.743719 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.743873 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:19:07.743903 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:19:07.743974 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.744015 (+ 41us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.744059 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 23:19:07.744139 4496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.741466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:38999 (local address 127.1.235.129:34899)
0809 23:19:07.741584 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:07.741601 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:07.741656 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:07.741764 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:07.741765 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:07.741766 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 23:19:07.741854 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.741856 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.742627 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.742627 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.743286 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.743291 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.743730 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.743731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.743776 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.743789 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 23:19:07.743979 (+ 190us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 23:19:07.743980 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 23:19:07.744012 (+ 32us) client_negotiation.cc:240] Negotiation successful
0809 23:19:07.744061 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":62,"threads_started":1}
I20260809 23:19:07.746469 4219 raft_consensus.cc:1261] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68 [term 1 FOLLOWER]: Refusing update from remote peer 5937ef2ea23d4abe8c53957da06dbada: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:07.746464 4373 raft_consensus.cc:1261] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee [term 1 FOLLOWER]: Refusing update from remote peer 5937ef2ea23d4abe8c53957da06dbada: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:07.746703 4463 consensus_queue.cc:1035] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [LEADER]: Connected to new peer: Peer: permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:07.746863 4459 consensus_queue.cc:1035] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:07.748736 4482 mvcc.cc:205] Tried to move back new op lower bound from 7316756675567738880 to 7316756673874300928. Current Snapshot: MvccSnapshot[applied={T|T < 7316756675567738880}]
I20260809 23:19:07.754726 4476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.752275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:60553 (local address 127.1.235.129:46455)
0809 23:19:07.752370 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.752372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.752489 (+ 117us) server_negotiation.cc:407] Connection header received
0809 23:19:07.752513 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.752514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.752523 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.752577 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:19:07.752725 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.753148 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.753841 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.754170 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.754236 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.754448 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:19:07.754480 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:19:07.754547 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.754646 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.754667 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 23:19:07.754906 4501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.752226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:46455 (local address 127.1.235.131:60553)
0809 23:19:07.752374 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:07.752384 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:07.752458 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:07.752581 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:07.752582 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:07.752583 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 23:19:07.752654 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.752655 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.753223 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.753224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.753746 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.753747 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.754239 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.754240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.754307 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.754322 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 23:19:07.754572 (+ 250us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 23:19:07.754573 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 23:19:07.754638 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 23:19:07.754679 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":88,"threads_started":1}
I20260809 23:19:07.764106 3892 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:07.764201 3892 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:07.764860 3892 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4: Sending DeleteTablet for 3 replicas of tablet 6a4c6009ef564b9ab2f5b813f5aef4ba
I20260809 23:19:07.765189 4044 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a4c6009ef564b9ab2f5b813f5aef4ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:07 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:38042
I20260809 23:19:07.765209 4197 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a4c6009ef564b9ab2f5b813f5aef4ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:07 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:60760
I20260809 23:19:07.765487 4506 tablet_replica.cc:330] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68: stopping tablet replica
I20260809 23:19:07.765622 4506 raft_consensus.cc:2229] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:07.765681 4352 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a4c6009ef564b9ab2f5b813f5aef4ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:07 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:39072
I20260809 23:19:07.765718 4506 raft_consensus.cc:2258] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:07.765923 3892 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:19:07.766088 3892 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:19:07.766494 4506 ts_tablet_manager.cc:1905] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:07.767570 4197 tablet_service.cc:1467] Processing CreateTablet for tablet f3396ec5d8f1482a80a3f9c0a2946af4 (DEFAULT_TABLE table=test-table [id=870c0dfac77a469ca7fab00076d240e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:07.767706 4197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3396ec5d8f1482a80a3f9c0a2946af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:07.768473 4506 ts_tablet_manager.cc:1918] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 23:19:07.768623 4506 log.cc:1196] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/6a4c6009ef564b9ab2f5b813f5aef4ba
I20260809 23:19:07.768975 4506 ts_tablet_manager.cc:1939] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 2816a3ea70d843819e43a98d84605b68: Deleting consensus metadata
I20260809 23:19:07.769197 4450 tablet_bootstrap.cc:492] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68: Bootstrap starting.
I20260809 23:19:07.769659 4450 tablet_bootstrap.cc:654] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:07.770138 3875 catalog_manager.cc:4841] TS 2816a3ea70d843819e43a98d84605b68 (127.1.235.130:36237): tablet 6a4c6009ef564b9ab2f5b813f5aef4ba (table test-table [id=e7f3133255f7481189ecade6f4ae21c1]) successfully deleted
I20260809 23:19:07.770330 4352 tablet_service.cc:1467] Processing CreateTablet for tablet f3396ec5d8f1482a80a3f9c0a2946af4 (DEFAULT_TABLE table=test-table [id=870c0dfac77a469ca7fab00076d240e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:07.770433 4352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3396ec5d8f1482a80a3f9c0a2946af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:07.770411 4044 tablet_service.cc:1467] Processing CreateTablet for tablet f3396ec5d8f1482a80a3f9c0a2946af4 (DEFAULT_TABLE table=test-table [id=870c0dfac77a469ca7fab00076d240e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:07.770522 4044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3396ec5d8f1482a80a3f9c0a2946af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:07.771625 4452 tablet_bootstrap.cc:492] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee: Bootstrap starting.
I20260809 23:19:07.771860 4507 tablet_replica.cc:330] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee: stopping tablet replica
I20260809 23:19:07.772003 4507 raft_consensus.cc:2229] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:07.772001 4454 tablet_bootstrap.cc:492] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada: Bootstrap starting.
I20260809 23:19:07.772106 4507 raft_consensus.cc:2258] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:07.772205 4452 tablet_bootstrap.cc:654] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:07.772341 4505 tablet_replica.cc:330] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada: stopping tablet replica
I20260809 23:19:07.772470 4505 raft_consensus.cc:2229] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:19:07.772488 4454 tablet_bootstrap.cc:654] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:07.772821 4507 ts_tablet_manager.cc:1905] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:07.772660 4505 raft_consensus.cc:2258] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:07.773389 4454 tablet_bootstrap.cc:492] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada: No bootstrap required, opened a new log
I20260809 23:19:07.773435 4454 ts_tablet_manager.cc:1397] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:07.773584 4454 raft_consensus.cc:348] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.773669 4454 raft_consensus.cc:374] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:07.773736 4454 raft_consensus.cc:729] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5937ef2ea23d4abe8c53957da06dbada, State: Initialized, Role: FOLLOWER
I20260809 23:19:07.773782 4454 consensus_queue.cc:260] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.773976 4454 ts_tablet_manager.cc:1428] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:07.774375 4507 ts_tablet_manager.cc:1918] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 23:19:07.774463 4507 log.cc:1196] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/6a4c6009ef564b9ab2f5b813f5aef4ba
I20260809 23:19:07.774708 4507 ts_tablet_manager.cc:1939] T 6a4c6009ef564b9ab2f5b813f5aef4ba P ad5e403ea37a4ed6b75dcfd412efedee: Deleting consensus metadata
I20260809 23:19:07.773658 4505 ts_tablet_manager.cc:1905] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:07.775095 3876 catalog_manager.cc:4841] TS ad5e403ea37a4ed6b75dcfd412efedee (127.1.235.131:38999): tablet 6a4c6009ef564b9ab2f5b813f5aef4ba (table test-table [id=e7f3133255f7481189ecade6f4ae21c1]) successfully deleted
I20260809 23:19:07.776909 4505 ts_tablet_manager.cc:1918] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 23:19:07.776988 4505 log.cc:1196] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/wal/wals/6a4c6009ef564b9ab2f5b813f5aef4ba
I20260809 23:19:07.777252 4505 ts_tablet_manager.cc:1939] T 6a4c6009ef564b9ab2f5b813f5aef4ba P 5937ef2ea23d4abe8c53957da06dbada: Deleting consensus metadata
I20260809 23:19:07.777626 3874 catalog_manager.cc:4841] TS 5937ef2ea23d4abe8c53957da06dbada (127.1.235.129:46455): tablet 6a4c6009ef564b9ab2f5b813f5aef4ba (table test-table [id=e7f3133255f7481189ecade6f4ae21c1]) successfully deleted
I20260809 23:19:07.777984 4450 tablet_bootstrap.cc:492] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68: No bootstrap required, opened a new log
I20260809 23:19:07.778052 4450 ts_tablet_manager.cc:1397] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20260809 23:19:07.778200 4450 raft_consensus.cc:348] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.778281 4450 raft_consensus.cc:374] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:07.778306 4450 raft_consensus.cc:729] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2816a3ea70d843819e43a98d84605b68, State: Initialized, Role: FOLLOWER
I20260809 23:19:07.778352 4450 consensus_queue.cc:260] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.778385 4452 tablet_bootstrap.cc:492] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee: No bootstrap required, opened a new log
I20260809 23:19:07.778427 4452 ts_tablet_manager.cc:1397] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260809 23:19:07.778443 4450 ts_tablet_manager.cc:1428] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 23:19:07.778563 4452 raft_consensus.cc:348] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.778638 4452 raft_consensus.cc:374] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:07.778664 4452 raft_consensus.cc:729] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5e403ea37a4ed6b75dcfd412efedee, State: Initialized, Role: FOLLOWER
I20260809 23:19:07.778702 4452 consensus_queue.cc:260] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.778798 4452 ts_tablet_manager.cc:1428] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:07.940017 4458 raft_consensus.cc:482] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:19:07.940119 4458 raft_consensus.cc:504] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.940538 4458 leader_election.cc:288] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5937ef2ea23d4abe8c53957da06dbada (127.1.235.129:46455), ad5e403ea37a4ed6b75dcfd412efedee (127.1.235.131:38999)
I20260809 23:19:07.943516 4476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.940809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:40123 (local address 127.1.235.129:46455)
0809 23:19:07.940856 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.940858 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.940942 (+ 84us) server_negotiation.cc:407] Connection header received
0809 23:19:07.940976 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.940977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.940987 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.941048 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:07.941235 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.941764 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.942810 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.943173 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.943227 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.943235 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.943388 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.943429 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 23:19:07.943580 4515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.940721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:38999 (local address 127.1.235.130:36457)
0809 23:19:07.940892 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:07.940908 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:07.940989 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:07.941166 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:07.941167 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:07.941169 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:07.941258 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.941259 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.941900 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.941901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.942775 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.942778 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.943301 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.943302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.943382 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.943385 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:19:07.943439 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 23:19:07.943473 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":98,"threads_started":1}
I20260809 23:19:07.943605 4448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.940792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:36457 (local address 127.1.235.131:38999)
0809 23:19:07.940838 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.940840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.940992 (+ 152us) server_negotiation.cc:407] Connection header received
0809 23:19:07.941071 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.941072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.941081 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.941155 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:07.941325 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.941771 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.942866 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.943193 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.943281 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.943289 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.943499 (+ 210us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.943533 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 23:19:07.943524 4512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.940714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:46455 (local address 127.1.235.130:40123)
0809 23:19:07.940854 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:07.940865 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:07.940930 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:07.941068 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:07.941069 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:07.941073 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:07.941156 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.941158 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.941869 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.941870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.942746 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.942748 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.943249 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.943251 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.943309 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.943313 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:19:07.943363 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 23:19:07.943390 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":47,"thread_start_us":61,"threads_started":1}
I20260809 23:19:07.943841 4373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3396ec5d8f1482a80a3f9c0a2946af4" candidate_uuid: "2816a3ea70d843819e43a98d84605b68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" is_pre_election: true
I20260809 23:19:07.943936 4373 raft_consensus.cc:2454] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2816a3ea70d843819e43a98d84605b68 in term 0.
I20260809 23:19:07.944001 4065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3396ec5d8f1482a80a3f9c0a2946af4" candidate_uuid: "2816a3ea70d843819e43a98d84605b68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5937ef2ea23d4abe8c53957da06dbada" is_pre_election: true
I20260809 23:19:07.944124 4065 raft_consensus.cc:2454] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2816a3ea70d843819e43a98d84605b68 in term 0.
I20260809 23:19:07.944173 4149 leader_election.cc:302] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2816a3ea70d843819e43a98d84605b68, ad5e403ea37a4ed6b75dcfd412efedee; no voters:
I20260809 23:19:07.944357 4458 raft_consensus.cc:2781] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:19:07.944393 4458 raft_consensus.cc:482] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:19:07.944406 4458 raft_consensus.cc:3037] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:07.945079 4458 raft_consensus.cc:504] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.945218 4458 leader_election.cc:288] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [CANDIDATE]: Term 1 election: Requested vote from peers 5937ef2ea23d4abe8c53957da06dbada (127.1.235.129:46455), ad5e403ea37a4ed6b75dcfd412efedee (127.1.235.131:38999)
I20260809 23:19:07.945349 4065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3396ec5d8f1482a80a3f9c0a2946af4" candidate_uuid: "2816a3ea70d843819e43a98d84605b68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5937ef2ea23d4abe8c53957da06dbada"
I20260809 23:19:07.945366 4373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3396ec5d8f1482a80a3f9c0a2946af4" candidate_uuid: "2816a3ea70d843819e43a98d84605b68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5e403ea37a4ed6b75dcfd412efedee"
I20260809 23:19:07.945423 4065 raft_consensus.cc:3037] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:07.945454 4373 raft_consensus.cc:3037] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:07.946139 4065 raft_consensus.cc:2454] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2816a3ea70d843819e43a98d84605b68 in term 1.
I20260809 23:19:07.946142 4373 raft_consensus.cc:2454] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2816a3ea70d843819e43a98d84605b68 in term 1.
I20260809 23:19:07.946314 4149 leader_election.cc:302] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2816a3ea70d843819e43a98d84605b68, ad5e403ea37a4ed6b75dcfd412efedee; no voters:
I20260809 23:19:07.946417 4458 raft_consensus.cc:2781] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:07.946553 4458 raft_consensus.cc:686] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [term 1 LEADER]: Becoming Leader. State: Replica: 2816a3ea70d843819e43a98d84605b68, State: Running, Role: LEADER
I20260809 23:19:07.946633 4458 consensus_queue.cc:237] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:07.947363 3891 catalog_manager.cc:5495] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2816a3ea70d843819e43a98d84605b68 (127.1.235.130). New cstate: current_term: 1 leader_uuid: "2816a3ea70d843819e43a98d84605b68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } health_report { overall_health: UNKNOWN } } }
I20260809 23:19:07.958650 4449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.956546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60762 (local address 127.1.235.130:36237)
0809 23:19:07.956593 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.956595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.956603 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:19:07.956693 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.956693 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.956709 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.956765 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:19:07.956843 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.957256 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.958024 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.958196 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.958248 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.958373 (+ 125us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:19:07.958466 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:19:07.958525 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.958556 (+ 31us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.958571 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260809 23:19:07.963267 4448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.960945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:41371 (local address 127.1.235.131:38999)
0809 23:19:07.960998 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.960999 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.961138 (+ 139us) server_negotiation.cc:407] Connection header received
0809 23:19:07.961198 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.961199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.961210 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.961263 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:19:07.961404 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.961887 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.962631 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.962862 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.962910 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.963098 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:19:07.963121 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:19:07.963157 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.963211 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.963223 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 23:19:07.963321 4521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.960863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:38999 (local address 127.1.235.130:41371)
0809 23:19:07.961066 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:07.961075 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:07.961148 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:07.961267 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:07.961268 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:07.961269 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 23:19:07.961334 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.961335 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.961973 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.961974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.962541 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.962543 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.962945 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.962946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.963003 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.963014 (+ 11us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 23:19:07.963160 (+ 146us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 23:19:07.963161 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 23:19:07.963209 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 23:19:07.963247 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":94,"threads_started":1}
I20260809 23:19:07.967444 4065 raft_consensus.cc:1261] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada [term 1 FOLLOWER]: Refusing update from remote peer 2816a3ea70d843819e43a98d84605b68: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:07.967473 4373 raft_consensus.cc:1261] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee [term 1 FOLLOWER]: Refusing update from remote peer 2816a3ea70d843819e43a98d84605b68: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:07.967692 4516 consensus_queue.cc:1035] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:07.967840 4458 consensus_queue.cc:1035] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:07.975082 4449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.972848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:37007 (local address 127.1.235.130:36237)
0809 23:19:07.972882 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:07.972884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:07.972893 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:19:07.972953 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:07.972954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:07.972962 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:07.973048 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:19:07.973156 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.973695 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.974406 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.974654 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.974715 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.974859 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:19:07.974889 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:19:07.974936 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:07.974996 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 23:19:07.975015 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 23:19:07.975123 4501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:07.972774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:36237 (local address 127.1.235.131:37007)
0809 23:19:07.972849 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:07.972860 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:07.972898 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:07.973051 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:07.973052 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:07.973053 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 23:19:07.973101 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.973102 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.973761 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.973762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.974343 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:07.974345 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:07.974728 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:07.974729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:07.974784 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:07.974791 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 23:19:07.974948 (+ 157us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 23:19:07.974949 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 23:19:07.974992 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 23:19:07.975039 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 23:19:07.975448 4483 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 23:19:09.494467 3892 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:09.494570 3892 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:09.495314 3892 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4: Sending DeleteTablet for 3 replicas of tablet f3396ec5d8f1482a80a3f9c0a2946af4
I20260809 23:19:09.495576 4197 tablet_service.cc:1514] Processing DeleteTablet for tablet f3396ec5d8f1482a80a3f9c0a2946af4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:09 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:60760
I20260809 23:19:09.495580 4044 tablet_service.cc:1514] Processing DeleteTablet for tablet f3396ec5d8f1482a80a3f9c0a2946af4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:09 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:38042
I20260809 23:19:09.495584 4351 tablet_service.cc:1514] Processing DeleteTablet for tablet f3396ec5d8f1482a80a3f9c0a2946af4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:09 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:39072
I20260809 23:19:09.495792 4553 tablet_replica.cc:330] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee: stopping tablet replica
I20260809 23:19:09.495872 4553 raft_consensus.cc:2229] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:09.495919 4553 raft_consensus.cc:2258] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:09.496012 4554 tablet_replica.cc:330] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada: stopping tablet replica
I20260809 23:19:09.496069 4554 raft_consensus.cc:2229] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:09.496132 4554 raft_consensus.cc:2258] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:09.496366 4554 ts_tablet_manager.cc:1905] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:09.496366 4553 ts_tablet_manager.cc:1905] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:09.498016 4553 ts_tablet_manager.cc:1918] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 23:19:09.498034 4554 ts_tablet_manager.cc:1918] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 23:19:09.498081 4554 log.cc:1196] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/wal/wals/f3396ec5d8f1482a80a3f9c0a2946af4
I20260809 23:19:09.498178 4553 log.cc:1196] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/f3396ec5d8f1482a80a3f9c0a2946af4
I20260809 23:19:09.498318 4554 ts_tablet_manager.cc:1939] T f3396ec5d8f1482a80a3f9c0a2946af4 P 5937ef2ea23d4abe8c53957da06dbada: Deleting consensus metadata
I20260809 23:19:09.498492 4553 ts_tablet_manager.cc:1939] T f3396ec5d8f1482a80a3f9c0a2946af4 P ad5e403ea37a4ed6b75dcfd412efedee: Deleting consensus metadata
I20260809 23:19:09.498651 3874 catalog_manager.cc:4841] TS 5937ef2ea23d4abe8c53957da06dbada (127.1.235.129:46455): tablet f3396ec5d8f1482a80a3f9c0a2946af4 (table test-table [id=870c0dfac77a469ca7fab00076d240e5]) successfully deleted
I20260809 23:19:09.498942 3876 catalog_manager.cc:4841] TS ad5e403ea37a4ed6b75dcfd412efedee (127.1.235.131:38999): tablet f3396ec5d8f1482a80a3f9c0a2946af4 (table test-table [id=870c0dfac77a469ca7fab00076d240e5]) successfully deleted
I20260809 23:19:09.499394 4555 tablet_replica.cc:330] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68: stopping tablet replica
I20260809 23:19:09.499464 4555 raft_consensus.cc:2229] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:19:09.499558 4555 raft_consensus.cc:2258] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:09.499837 4555 ts_tablet_manager.cc:1905] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:09.501346 4555 ts_tablet_manager.cc:1918] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 23:19:09.501407 4555 log.cc:1196] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/f3396ec5d8f1482a80a3f9c0a2946af4
I20260809 23:19:09.501693 4555 ts_tablet_manager.cc:1939] T f3396ec5d8f1482a80a3f9c0a2946af4 P 2816a3ea70d843819e43a98d84605b68: Deleting consensus metadata
I20260809 23:19:09.502012 3875 catalog_manager.cc:4841] TS 2816a3ea70d843819e43a98d84605b68 (127.1.235.130:36237): tablet f3396ec5d8f1482a80a3f9c0a2946af4 (table test-table [id=870c0dfac77a469ca7fab00076d240e5]) successfully deleted
Aug 09 23:19:09 dist-test-slave-6nmv krb5kdc[3842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317549, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 23:19:09 dist-test-slave-6nmv krb5kdc[3842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317549, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:09.523696 4563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:09.512768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46878 (local address 127.1.235.190:40159)
0809 23:19:09.512935 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:09.512937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:09.512961 (+ 24us) server_negotiation.cc:407] Connection header received
0809 23:19:09.513028 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:09.513029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:09.513047 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:09.513131 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:09.513648 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:09.514178 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:09.514867 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:09.515055 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:09.515140 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:09.521392 (+ 6252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:09.521394 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:09.521394 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:09.521402 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:09.522764 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:09.523053 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:09.523054 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:09.523055 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:09.523113 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:09.523268 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:09.523268 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:09.523269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:09.523377 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:09.523450 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:09.523560 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 23:19:09.523631 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":86,"threads_started":1}
I20260809 23:19:09.525233 3892 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46878:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:19:09.525393 3892 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:19:09.526605 4044 tablet_service.cc:1467] Processing CreateTablet for tablet d4192419214245279f7e3adb1bc975b4 (DEFAULT_TABLE table=test-table [id=cb3457fdf6324e2188e9a1d822a860de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:09.526649 4197 tablet_service.cc:1467] Processing CreateTablet for tablet d4192419214245279f7e3adb1bc975b4 (DEFAULT_TABLE table=test-table [id=cb3457fdf6324e2188e9a1d822a860de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:09.526674 4351 tablet_service.cc:1467] Processing CreateTablet for tablet d4192419214245279f7e3adb1bc975b4 (DEFAULT_TABLE table=test-table [id=cb3457fdf6324e2188e9a1d822a860de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:09.526736 4044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4192419214245279f7e3adb1bc975b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:09.526768 4197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4192419214245279f7e3adb1bc975b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:09.526782 4351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4192419214245279f7e3adb1bc975b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:09.527789 4564 tablet_bootstrap.cc:492] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68: Bootstrap starting.
I20260809 23:19:09.528064 4565 tablet_bootstrap.cc:492] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada: Bootstrap starting.
I20260809 23:19:09.528178 4564 tablet_bootstrap.cc:654] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:09.528239 4566 tablet_bootstrap.cc:492] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee: Bootstrap starting.
I20260809 23:19:09.528440 4565 tablet_bootstrap.cc:654] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:09.528555 4566 tablet_bootstrap.cc:654] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:09.528879 4564 tablet_bootstrap.cc:492] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68: No bootstrap required, opened a new log
I20260809 23:19:09.528934 4564 ts_tablet_manager.cc:1397] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:09.529095 4564 raft_consensus.cc:348] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.529172 4564 raft_consensus.cc:374] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:09.529196 4564 raft_consensus.cc:729] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2816a3ea70d843819e43a98d84605b68, State: Initialized, Role: FOLLOWER
I20260809 23:19:09.529202 4566 tablet_bootstrap.cc:492] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee: No bootstrap required, opened a new log
I20260809 23:19:09.529248 4566 ts_tablet_manager.cc:1397] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:09.529251 4564 consensus_queue.cc:260] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.529352 4564 ts_tablet_manager.cc:1428] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:09.529350 4566 raft_consensus.cc:348] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.529414 4566 raft_consensus.cc:374] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:09.529469 4566 raft_consensus.cc:729] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5e403ea37a4ed6b75dcfd412efedee, State: Initialized, Role: FOLLOWER
I20260809 23:19:09.529603 4565 tablet_bootstrap.cc:492] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada: No bootstrap required, opened a new log
I20260809 23:19:09.529657 4565 ts_tablet_manager.cc:1397] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:19:09.529737 4566 consensus_queue.cc:260] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.529764 4565 raft_consensus.cc:348] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.529855 4565 raft_consensus.cc:374] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:09.529891 4565 raft_consensus.cc:729] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5937ef2ea23d4abe8c53957da06dbada, State: Initialized, Role: FOLLOWER
I20260809 23:19:09.529958 4565 consensus_queue.cc:260] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.530026 4566 ts_tablet_manager.cc:1428] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260809 23:19:09.530153 4565 ts_tablet_manager.cc:1428] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:09.624994 4527 raft_consensus.cc:482] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:19:09.625119 4527 raft_consensus.cc:504] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.625329 4527 leader_election.cc:288] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5937ef2ea23d4abe8c53957da06dbada (127.1.235.129:46455), 2816a3ea70d843819e43a98d84605b68 (127.1.235.130:36237)
I20260809 23:19:09.625546 4065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4192419214245279f7e3adb1bc975b4" candidate_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5937ef2ea23d4abe8c53957da06dbada" is_pre_election: true
I20260809 23:19:09.625546 4219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4192419214245279f7e3adb1bc975b4" candidate_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2816a3ea70d843819e43a98d84605b68" is_pre_election: true
I20260809 23:19:09.625654 4065 raft_consensus.cc:2454] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5e403ea37a4ed6b75dcfd412efedee in term 0.
I20260809 23:19:09.625669 4219 raft_consensus.cc:2454] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad5e403ea37a4ed6b75dcfd412efedee in term 0.
I20260809 23:19:09.625844 4299 leader_election.cc:302] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2816a3ea70d843819e43a98d84605b68, ad5e403ea37a4ed6b75dcfd412efedee; no voters:
I20260809 23:19:09.625946 4527 raft_consensus.cc:2781] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:19:09.626013 4527 raft_consensus.cc:482] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:19:09.626039 4527 raft_consensus.cc:3037] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:09.626791 4527 raft_consensus.cc:504] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.626957 4527 leader_election.cc:288] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [CANDIDATE]: Term 1 election: Requested vote from peers 5937ef2ea23d4abe8c53957da06dbada (127.1.235.129:46455), 2816a3ea70d843819e43a98d84605b68 (127.1.235.130:36237)
I20260809 23:19:09.627100 4065 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4192419214245279f7e3adb1bc975b4" candidate_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5937ef2ea23d4abe8c53957da06dbada"
I20260809 23:19:09.627134 4219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4192419214245279f7e3adb1bc975b4" candidate_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2816a3ea70d843819e43a98d84605b68"
I20260809 23:19:09.627193 4219 raft_consensus.cc:3037] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:09.627192 4065 raft_consensus.cc:3037] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:09.628008 4219 raft_consensus.cc:2454] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5e403ea37a4ed6b75dcfd412efedee in term 1.
I20260809 23:19:09.628010 4065 raft_consensus.cc:2454] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad5e403ea37a4ed6b75dcfd412efedee in term 1.
I20260809 23:19:09.628208 4298 leader_election.cc:302] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5937ef2ea23d4abe8c53957da06dbada, ad5e403ea37a4ed6b75dcfd412efedee; no voters:
I20260809 23:19:09.628309 4527 raft_consensus.cc:2781] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:09.628377 4527 raft_consensus.cc:686] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [term 1 LEADER]: Becoming Leader. State: Replica: ad5e403ea37a4ed6b75dcfd412efedee, State: Running, Role: LEADER
I20260809 23:19:09.628450 4527 consensus_queue.cc:237] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.629078 3891 catalog_manager.cc:5495] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee reported cstate change: term changed from 0 to 1, leader changed from <none> to ad5e403ea37a4ed6b75dcfd412efedee (127.1.235.131). New cstate: current_term: 1 leader_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } health_report { overall_health: HEALTHY } } }
I20260809 23:19:09.647890 4576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:09.645490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39082 (local address 127.1.235.131:38999)
0809 23:19:09.645659 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:09.645661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:09.645668 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:19:09.645693 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:09.645694 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:09.645703 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:09.645775 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:19:09.645945 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:09.646428 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:09.647175 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:09.647400 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:09.647478 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:09.647642 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:19:09.647675 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:19:09.647736 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:09.647788 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 23:19:09.647808 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":95,"threads_started":1}
I20260809 23:19:09.651820 4576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:09.650051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:57251 (local address 127.1.235.131:38999)
0809 23:19:09.650109 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:09.650111 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:09.650126 (+ 15us) server_negotiation.cc:407] Connection header received
0809 23:19:09.650165 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:09.650166 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:09.650173 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:09.650205 (+ 32us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:19:09.650306 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:09.650707 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:09.651330 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:09.651479 (+ 149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:09.651520 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:09.651633 (+ 113us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:19:09.651669 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:19:09.651701 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:09.651737 (+ 36us) server_negotiation.cc:299] Negotiation successful
0809 23:19:09.651753 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 23:19:09.651887 4579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:09.649912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:38999 (local address 127.1.235.131:57251)
0809 23:19:09.650061 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:09.650070 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:09.650120 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:09.650214 (+ 94us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:09.650215 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:09.650216 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 23:19:09.650260 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:09.650261 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:09.650764 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:09.650765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:09.651271 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:09.651272 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:09.651538 (+ 266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:09.651538 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:09.651572 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:09.651575 (+ 3us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 23:19:09.651706 (+ 131us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 23:19:09.651707 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 23:19:09.651735 (+ 28us) client_negotiation.cc:240] Negotiation successful
0809 23:19:09.651761 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":90,"threads_started":1}
I20260809 23:19:09.653703 4219 raft_consensus.cc:1261] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68 [term 1 FOLLOWER]: Refusing update from remote peer ad5e403ea37a4ed6b75dcfd412efedee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:09.653885 4065 raft_consensus.cc:1261] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada [term 1 FOLLOWER]: Refusing update from remote peer ad5e403ea37a4ed6b75dcfd412efedee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:09.653960 4527 consensus_queue.cc:1035] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [LEADER]: Connected to new peer: Peer: permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:09.654065 4531 consensus_queue.cc:1035] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [LEADER]: Connected to new peer: Peer: permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:09.664052 3892 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:09.664149 3892 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:09.664741 3892 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4: Sending DeleteTablet for 3 replicas of tablet d4192419214245279f7e3adb1bc975b4
I20260809 23:19:09.664954 4044 tablet_service.cc:1514] Processing DeleteTablet for tablet d4192419214245279f7e3adb1bc975b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:09 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:38042
I20260809 23:19:09.665011 4197 tablet_service.cc:1514] Processing DeleteTablet for tablet d4192419214245279f7e3adb1bc975b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:09 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:60760
I20260809 23:19:09.665040 4554 tablet_replica.cc:330] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada: stopping tablet replica
I20260809 23:19:09.665089 4554 raft_consensus.cc:2229] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:09.665126 4554 raft_consensus.cc:2258] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:09.665108 4555 tablet_replica.cc:330] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68: stopping tablet replica
I20260809 23:19:09.665182 4555 raft_consensus.cc:2229] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:09.665215 4555 raft_consensus.cc:2258] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:09.665203 4351 tablet_service.cc:1514] Processing DeleteTablet for tablet d4192419214245279f7e3adb1bc975b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:09 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:39072
I20260809 23:19:09.665277 4553 tablet_replica.cc:330] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee: stopping tablet replica
I20260809 23:19:09.665328 4553 raft_consensus.cc:2229] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:19:09.665391 4553 raft_consensus.cc:2258] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:09.665478 3892 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46878:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:19:09.665639 3892 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:19:09.665684 4553 ts_tablet_manager.cc:1905] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:09.666909 4197 tablet_service.cc:1467] Processing CreateTablet for tablet 75b6b1c494cd4ad98f876d27611bf1c6 (DEFAULT_TABLE table=test-table [id=3cef22008eae41feb2b52e746523d7ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:09.667032 4197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75b6b1c494cd4ad98f876d27611bf1c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:09.667271 4044 tablet_service.cc:1467] Processing CreateTablet for tablet 75b6b1c494cd4ad98f876d27611bf1c6 (DEFAULT_TABLE table=test-table [id=3cef22008eae41feb2b52e746523d7ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:09.667395 4044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75b6b1c494cd4ad98f876d27611bf1c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:09.667428 4553 ts_tablet_manager.cc:1918] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 23:19:09.667467 4553 log.cc:1196] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/d4192419214245279f7e3adb1bc975b4
I20260809 23:19:09.667670 4553 ts_tablet_manager.cc:1939] T d4192419214245279f7e3adb1bc975b4 P ad5e403ea37a4ed6b75dcfd412efedee: Deleting consensus metadata
I20260809 23:19:09.668350 4564 tablet_bootstrap.cc:492] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68: Bootstrap starting.
I20260809 23:19:09.668601 3876 catalog_manager.cc:4841] TS ad5e403ea37a4ed6b75dcfd412efedee (127.1.235.131:38999): tablet d4192419214245279f7e3adb1bc975b4 (table test-table [id=cb3457fdf6324e2188e9a1d822a860de]) successfully deleted
I20260809 23:19:09.668651 4564 tablet_bootstrap.cc:654] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:09.668926 4351 tablet_service.cc:1467] Processing CreateTablet for tablet 75b6b1c494cd4ad98f876d27611bf1c6 (DEFAULT_TABLE table=test-table [id=3cef22008eae41feb2b52e746523d7ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:09.669028 4351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75b6b1c494cd4ad98f876d27611bf1c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:09.669024 4565 tablet_bootstrap.cc:492] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada: Bootstrap starting.
I20260809 23:19:09.669374 4565 tablet_bootstrap.cc:654] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:09.670020 4555 ts_tablet_manager.cc:1905] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:09.670077 4565 tablet_bootstrap.cc:492] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada: No bootstrap required, opened a new log
I20260809 23:19:09.670120 4565 ts_tablet_manager.cc:1397] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:09.670264 4565 raft_consensus.cc:348] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.670344 4565 raft_consensus.cc:374] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:09.670367 4565 raft_consensus.cc:729] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5937ef2ea23d4abe8c53957da06dbada, State: Initialized, Role: FOLLOWER
I20260809 23:19:09.670400 4565 consensus_queue.cc:260] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.670420 4566 tablet_bootstrap.cc:492] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee: Bootstrap starting.
I20260809 23:19:09.670504 4565 ts_tablet_manager.cc:1428] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:09.670789 4566 tablet_bootstrap.cc:654] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:09.670853 4554 ts_tablet_manager.cc:1905] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:09.671295 4564 tablet_bootstrap.cc:492] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68: No bootstrap required, opened a new log
I20260809 23:19:09.671343 4564 ts_tablet_manager.cc:1397] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 23:19:09.671482 4564 raft_consensus.cc:348] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.671486 4555 ts_tablet_manager.cc:1918] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 23:19:09.671557 4564 raft_consensus.cc:374] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:09.671583 4564 raft_consensus.cc:729] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2816a3ea70d843819e43a98d84605b68, State: Initialized, Role: FOLLOWER
I20260809 23:19:09.671598 4555 log.cc:1196] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/d4192419214245279f7e3adb1bc975b4
I20260809 23:19:09.671639 4564 consensus_queue.cc:260] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.671765 4564 ts_tablet_manager.cc:1428] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:09.671855 4555 ts_tablet_manager.cc:1939] T d4192419214245279f7e3adb1bc975b4 P 2816a3ea70d843819e43a98d84605b68: Deleting consensus metadata
I20260809 23:19:09.672145 3875 catalog_manager.cc:4841] TS 2816a3ea70d843819e43a98d84605b68 (127.1.235.130:36237): tablet d4192419214245279f7e3adb1bc975b4 (table test-table [id=cb3457fdf6324e2188e9a1d822a860de]) successfully deleted
I20260809 23:19:09.672374 4554 ts_tablet_manager.cc:1918] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 23:19:09.672431 4554 log.cc:1196] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-0/wal/wals/d4192419214245279f7e3adb1bc975b4
I20260809 23:19:09.672667 4554 ts_tablet_manager.cc:1939] T d4192419214245279f7e3adb1bc975b4 P 5937ef2ea23d4abe8c53957da06dbada: Deleting consensus metadata
I20260809 23:19:09.672924 4566 tablet_bootstrap.cc:492] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee: No bootstrap required, opened a new log
I20260809 23:19:09.672963 4566 ts_tablet_manager.cc:1397] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260809 23:19:09.672998 3874 catalog_manager.cc:4841] TS 5937ef2ea23d4abe8c53957da06dbada (127.1.235.129:46455): tablet d4192419214245279f7e3adb1bc975b4 (table test-table [id=cb3457fdf6324e2188e9a1d822a860de]) successfully deleted
I20260809 23:19:09.673067 4566 raft_consensus.cc:348] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.673139 4566 raft_consensus.cc:374] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:09.673159 4566 raft_consensus.cc:729] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad5e403ea37a4ed6b75dcfd412efedee, State: Initialized, Role: FOLLOWER
I20260809 23:19:09.673214 4566 consensus_queue.cc:260] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.673287 4566 ts_tablet_manager.cc:1428] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:09.681156 4572 raft_consensus.cc:482] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:19:09.681211 4572 raft_consensus.cc:504] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.681340 4572 leader_election.cc:288] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2816a3ea70d843819e43a98d84605b68 (127.1.235.130:36237), ad5e403ea37a4ed6b75dcfd412efedee (127.1.235.131:38999)
I20260809 23:19:09.681463 4373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75b6b1c494cd4ad98f876d27611bf1c6" candidate_uuid: "5937ef2ea23d4abe8c53957da06dbada" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" is_pre_election: true
I20260809 23:19:09.681465 4219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75b6b1c494cd4ad98f876d27611bf1c6" candidate_uuid: "5937ef2ea23d4abe8c53957da06dbada" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2816a3ea70d843819e43a98d84605b68" is_pre_election: true
I20260809 23:19:09.681530 4373 raft_consensus.cc:2454] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5937ef2ea23d4abe8c53957da06dbada in term 0.
I20260809 23:19:09.681537 4219 raft_consensus.cc:2454] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5937ef2ea23d4abe8c53957da06dbada in term 0.
I20260809 23:19:09.681658 3990 leader_election.cc:302] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2816a3ea70d843819e43a98d84605b68, 5937ef2ea23d4abe8c53957da06dbada; no voters:
I20260809 23:19:09.681746 4572 raft_consensus.cc:2781] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:19:09.681775 4572 raft_consensus.cc:482] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:19:09.681802 4572 raft_consensus.cc:3037] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:09.682353 4572 raft_consensus.cc:504] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.682480 4572 leader_election.cc:288] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [CANDIDATE]: Term 1 election: Requested vote from peers 2816a3ea70d843819e43a98d84605b68 (127.1.235.130:36237), ad5e403ea37a4ed6b75dcfd412efedee (127.1.235.131:38999)
I20260809 23:19:09.682601 4219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75b6b1c494cd4ad98f876d27611bf1c6" candidate_uuid: "5937ef2ea23d4abe8c53957da06dbada" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2816a3ea70d843819e43a98d84605b68"
I20260809 23:19:09.682628 4373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75b6b1c494cd4ad98f876d27611bf1c6" candidate_uuid: "5937ef2ea23d4abe8c53957da06dbada" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad5e403ea37a4ed6b75dcfd412efedee"
I20260809 23:19:09.682688 4219 raft_consensus.cc:3037] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:09.682698 4373 raft_consensus.cc:3037] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:09.683177 4219 raft_consensus.cc:2454] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5937ef2ea23d4abe8c53957da06dbada in term 1.
I20260809 23:19:09.683318 4373 raft_consensus.cc:2454] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5937ef2ea23d4abe8c53957da06dbada in term 1.
I20260809 23:19:09.683373 3990 leader_election.cc:302] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2816a3ea70d843819e43a98d84605b68, 5937ef2ea23d4abe8c53957da06dbada; no voters:
I20260809 23:19:09.683499 4572 raft_consensus.cc:2781] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:09.683607 4572 raft_consensus.cc:686] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [term 1 LEADER]: Becoming Leader. State: Replica: 5937ef2ea23d4abe8c53957da06dbada, State: Running, Role: LEADER
I20260809 23:19:09.683657 4572 consensus_queue.cc:237] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } }
I20260809 23:19:09.684098 3892 catalog_manager.cc:5495] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada reported cstate change: term changed from 0 to 1, leader changed from <none> to 5937ef2ea23d4abe8c53957da06dbada (127.1.235.129). New cstate: current_term: 1 leader_uuid: "5937ef2ea23d4abe8c53957da06dbada" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5937ef2ea23d4abe8c53957da06dbada" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 } health_report { overall_health: UNKNOWN } } }
I20260809 23:19:09.694286 4588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:09.692039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38054 (local address 127.1.235.129:46455)
0809 23:19:09.692181 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:09.692183 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:09.692190 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:19:09.692214 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:09.692214 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:09.692223 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:09.692297 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:19:09.692400 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:09.692882 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:09.693588 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:09.693781 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:09.693905 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:09.694042 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:19:09.694072 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:19:09.694129 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:09.694184 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 23:19:09.694206 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":77,"threads_started":1}
I20260809 23:19:09.696121 4219 raft_consensus.cc:1261] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68 [term 1 FOLLOWER]: Refusing update from remote peer 5937ef2ea23d4abe8c53957da06dbada: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:09.696261 4373 raft_consensus.cc:1261] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee [term 1 FOLLOWER]: Refusing update from remote peer 5937ef2ea23d4abe8c53957da06dbada: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:09.696306 4586 consensus_queue.cc:1035] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [LEADER]: Connected to new peer: Peer: permanent_uuid: "2816a3ea70d843819e43a98d84605b68" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:09.696547 4586 consensus_queue.cc:1035] T 75b6b1c494cd4ad98f876d27611bf1c6 P 5937ef2ea23d4abe8c53957da06dbada [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad5e403ea37a4ed6b75dcfd412efedee" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 38999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 23:19:09.700886 4534 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 23:19:11.218194 3891 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:11.218297 3891 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:11.219050 3891 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 21404a3d6d9449e7a3ca19e9f5a23dc4: Sending DeleteTablet for 3 replicas of tablet 75b6b1c494cd4ad98f876d27611bf1c6
I20260809 23:19:11.219321 4044 tablet_service.cc:1514] Processing DeleteTablet for tablet 75b6b1c494cd4ad98f876d27611bf1c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:11 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:38042
I20260809 23:19:11.219332 4197 tablet_service.cc:1514] Processing DeleteTablet for tablet 75b6b1c494cd4ad98f876d27611bf1c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:11 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:60760
I20260809 23:19:11.219357 4351 tablet_service.cc:1514] Processing DeleteTablet for tablet 75b6b1c494cd4ad98f876d27611bf1c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:11 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:39072
I20260809 23:19:11.219533 4619 tablet_replica.cc:330] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68: stopping tablet replica
I20260809 23:19:11.219663 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 3973
I20260809 23:19:11.219595 4619 raft_consensus.cc:2229] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:11.223568 4619 raft_consensus.cc:2258] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:11.223819 4619 ts_tablet_manager.cc:1905] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:11.225363 4619 ts_tablet_manager.cc:1918] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 23:19:11.225414 4619 log.cc:1196] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/75b6b1c494cd4ad98f876d27611bf1c6
I20260809 23:19:11.225654 4619 ts_tablet_manager.cc:1939] T 75b6b1c494cd4ad98f876d27611bf1c6 P 2816a3ea70d843819e43a98d84605b68: Deleting consensus metadata
I20260809 23:19:11.225986 3875 catalog_manager.cc:4841] TS 2816a3ea70d843819e43a98d84605b68 (127.1.235.130:36237): tablet 75b6b1c494cd4ad98f876d27611bf1c6 (table test-table [id=3cef22008eae41feb2b52e746523d7ae]) successfully deleted
I20260809 23:19:11.228312 4618 tablet_replica.cc:330] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee: stopping tablet replica
I20260809 23:19:11.228389 4618 raft_consensus.cc:2229] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:11.228435 4618 raft_consensus.cc:2258] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:11.228804 4618 ts_tablet_manager.cc:1905] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 23:19:11.228814 3874 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.235.129:46455 (error 108)
I20260809 23:19:11.229430 4622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:11.229207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:46455 (local address 127.0.0.1:38056)
0809 23:19:11.229342 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:11.229393 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.129:46455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":74,"threads_started":1}
I20260809 23:19:11.229463 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 4129
W20260809 23:19:11.229557 3874 catalog_manager.cc:4584] TS 5937ef2ea23d4abe8c53957da06dbada (127.1.235.129:46455): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 75b6b1c494cd4ad98f876d27611bf1c6: Network error: Client connection negotiation failed: client connection to 127.1.235.129:46455: connect: Connection refused (error 111)
I20260809 23:19:11.235050 4618 ts_tablet_manager.cc:1918] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 23:19:11.235126 4618 log.cc:1196] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/75b6b1c494cd4ad98f876d27611bf1c6
I20260809 23:19:11.235327 4618 ts_tablet_manager.cc:1939] T 75b6b1c494cd4ad98f876d27611bf1c6 P ad5e403ea37a4ed6b75dcfd412efedee: Deleting consensus metadata
I20260809 23:19:11.235654 3876 catalog_manager.cc:4841] TS ad5e403ea37a4ed6b75dcfd412efedee (127.1.235.131:38999): tablet 75b6b1c494cd4ad98f876d27611bf1c6 (table test-table [id=3cef22008eae41feb2b52e746523d7ae]) successfully deleted
I20260809 23:19:11.236740 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 4280
I20260809 23:19:11.243561 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 3858
2026-08-09T23:19:11Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5929 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:19:11 dist-test-slave-6nmv krb5kdc[4626](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:19:11 dist-test-slave-6nmv krb5kdc[4626](info): set up 2 sockets
Aug 09 23:19:11 dist-test-slave-6nmv krb5kdc[4626](info): commencing operation
krb5kdc: starting...
W20260809 23:19:12.289722 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:19:12 dist-test-slave-6nmv krb5kdc[4626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:19:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:19:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:19:12.402572 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:46873
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:40289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:46873
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:12.482362 4641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:12.482587 4641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:12.482611 4641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:12.483665 4641 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:12.483714 4641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:12.483728 4641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:12.483740 4641 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:12.483752 4641 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:19:12.485057 4641 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:40289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:46873
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:46873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4641
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:12.485266 4641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:12.485430 4641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:12.490437 4646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:12.490528 4641 server_base.cc:1034] running on GCE node
W20260809 23:19:12.490474 4647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:12.490480 4649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:12.490973 4641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:12.491254 4641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:12.492393 4641 hybrid_clock.cc:648] HybridClock initialized: now 1786317552492380 us; error 26 us; skew 500 ppm
Aug 09 23:19:12 dist-test-slave-6nmv krb5kdc[4626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317552, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:12.494791 4641 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:19:12.495204 4641 webserver.cc:460] Webserver started at http://127.1.235.190:35043/ using document root <none> and password file <none>
I20260809 23:19:12.495402 4641 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:12.495441 4641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:12.495628 4641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:12.496587 4641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "1caaf78a508d4a7aaef4eebb68fa14cc"
format_stamp: "Formatted at 2026-08-09 23:19:12 on dist-test-slave-6nmv"
server_key: "b0522c83356dd0806b68f3c34d4d6305"
server_key_iv: "a14cf3a956f1d5983d799b61c515920a"
server_key_version: "encryptionkey@0"
I20260809 23:19:12.496925 4641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "1caaf78a508d4a7aaef4eebb68fa14cc"
format_stamp: "Formatted at 2026-08-09 23:19:12 on dist-test-slave-6nmv"
server_key: "b0522c83356dd0806b68f3c34d4d6305"
server_key_iv: "a14cf3a956f1d5983d799b61c515920a"
server_key_version: "encryptionkey@0"
I20260809 23:19:12.498153 4641 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:19:12.498826 4656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:12.499008 4641 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:12.499087 4641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "1caaf78a508d4a7aaef4eebb68fa14cc"
format_stamp: "Formatted at 2026-08-09 23:19:12 on dist-test-slave-6nmv"
server_key: "b0522c83356dd0806b68f3c34d4d6305"
server_key_iv: "a14cf3a956f1d5983d799b61c515920a"
server_key_version: "encryptionkey@0"
I20260809 23:19:12.499135 4641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:12.515092 4641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:12.517043 4641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:12.517139 4641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:12.520735 4641 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:46873
I20260809 23:19:12.520787 4715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:46873 every 8 connection(s)
I20260809 23:19:12.521063 4641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:19:12.521870 4716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:12.523818 4716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc: Bootstrap starting.
I20260809 23:19:12.524356 4716 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:12.524628 4716 log.cc:824] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:12.525286 4716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc: No bootstrap required, opened a new log
I20260809 23:19:12.526995 4716 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1caaf78a508d4a7aaef4eebb68fa14cc" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 46873 } }
I20260809 23:19:12.527096 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 4641
I20260809 23:19:12.527138 4716 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:12.527182 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:19:12.527181 4716 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1caaf78a508d4a7aaef4eebb68fa14cc, State: Initialized, Role: FOLLOWER
I20260809 23:19:12.527307 4716 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1caaf78a508d4a7aaef4eebb68fa14cc" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 46873 } }
I20260809 23:19:12.527367 1966 external_mini_cluster.cc:1428] Setting key 9a7806a91f47faaa4142d9e96767492f
I20260809 23:19:12.527381 4716 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:19:12.527417 4716 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:19:12.527463 4716 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:12.528478 4716 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1caaf78a508d4a7aaef4eebb68fa14cc" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 46873 } }
I20260809 23:19:12.528576 4716 leader_election.cc:302] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1caaf78a508d4a7aaef4eebb68fa14cc; no voters:
I20260809 23:19:12.528720 4716 leader_election.cc:288] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:19:12.528759 4721 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:12.528929 4721 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [term 1 LEADER]: Becoming Leader. State: Replica: 1caaf78a508d4a7aaef4eebb68fa14cc, State: Running, Role: LEADER
I20260809 23:19:12.528957 4716 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:12.529065 4721 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1caaf78a508d4a7aaef4eebb68fa14cc" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 46873 } }
I20260809 23:19:12.529553 4721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1caaf78a508d4a7aaef4eebb68fa14cc. Latest consensus state: current_term: 1 leader_uuid: "1caaf78a508d4a7aaef4eebb68fa14cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1caaf78a508d4a7aaef4eebb68fa14cc" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 46873 } } }
I20260809 23:19:12.529806 4721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:12.529718 4722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1caaf78a508d4a7aaef4eebb68fa14cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1caaf78a508d4a7aaef4eebb68fa14cc" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 46873 } } }
I20260809 23:19:12.530285 4722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:12.530443 4732 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:19:12.531138 4732 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:19:12.532958 4732 catalog_manager.cc:1347] Generated new cluster ID: f1badfd59fe14c84ab435acbd8d46692
I20260809 23:19:12.533010 4732 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 23:19:12 dist-test-slave-6nmv krb5kdc[4626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317552, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:12.539377 4720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:12.527830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55366 (local address 127.1.235.190:46873)
0809 23:19:12.528038 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:12.528048 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:12.528087 (+ 39us) server_negotiation.cc:407] Connection header received
0809 23:19:12.528219 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:12.528225 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:12.528277 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:12.528401 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:12.529133 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:12.530689 (+ 1556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:12.531722 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:12.532293 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:12.532394 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:12.535040 (+ 2646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:12.535044 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:12.535044 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:12.535055 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:12.537685 (+ 2630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:12.538144 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:12.538147 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:12.538147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:12.538256 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:12.538483 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:12.538483 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:12.538484 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:12.538767 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:12.538917 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:12.539031 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 23:19:12.539155 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":99,"threads_started":1}
I20260809 23:19:12.544842 4732 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:19:12.545357 4732 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:19:12.548312 4732 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1caaf78a508d4a7aaef4eebb68fa14cc: Generated new TSK 0
I20260809 23:19:12.548473 4732 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:19:12.574729 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:46873
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:40289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:12.654807 4744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:12.654989 4744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:12.655011 4744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:12.656032 4744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:12.656066 4744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:12.656096 4744 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:19:12.657320 4744 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:40289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:46873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4744
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:12.657495 4744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:12.657646 4744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:12.662467 4751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:12.662639 4744 server_base.cc:1034] running on GCE node
W20260809 23:19:12.662467 4753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:12.662738 4750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:12.662968 4744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:12.663223 4744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:12.664367 4744 hybrid_clock.cc:648] HybridClock initialized: now 1786317552664354 us; error 39 us; skew 500 ppm
Aug 09 23:19:12 dist-test-slave-6nmv krb5kdc[4626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317552, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:12.666679 4744 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:19:12.667181 4744 webserver.cc:460] Webserver started at http://127.1.235.129:32819/ using document root <none> and password file <none>
I20260809 23:19:12.667383 4744 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:12.667424 4744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:12.667577 4744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:12.668533 4744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "8cd6fc4586f34419a3ef9a058c62e620"
format_stamp: "Formatted at 2026-08-09 23:19:12 on dist-test-slave-6nmv"
server_key: "e60cde7b72a23f5a962f47847ab9b685"
server_key_iv: "de93e71757868ac213875a0920810838"
server_key_version: "encryptionkey@0"
I20260809 23:19:12.668924 4744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "8cd6fc4586f34419a3ef9a058c62e620"
format_stamp: "Formatted at 2026-08-09 23:19:12 on dist-test-slave-6nmv"
server_key: "e60cde7b72a23f5a962f47847ab9b685"
server_key_iv: "de93e71757868ac213875a0920810838"
server_key_version: "encryptionkey@0"
I20260809 23:19:12.670276 4744 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:19:12.670948 4761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:12.671136 4744 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:12.671228 4744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "8cd6fc4586f34419a3ef9a058c62e620"
format_stamp: "Formatted at 2026-08-09 23:19:12 on dist-test-slave-6nmv"
server_key: "e60cde7b72a23f5a962f47847ab9b685"
server_key_iv: "de93e71757868ac213875a0920810838"
server_key_version: "encryptionkey@0"
I20260809 23:19:12.671290 4744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:12.679513 4744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:12.681131 4744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:12.681258 4744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:12.681433 4744 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:12.681733 4744 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:12.681787 4744 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:12.681866 4744 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:12.681910 4744 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:12.687556 4744 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:41237
I20260809 23:19:12.687614 4885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:41237 every 8 connection(s)
I20260809 23:19:12.687862 4744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:19:12.688854 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 4744
I20260809 23:19:12.688949 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:19:12.689100 1966 external_mini_cluster.cc:1428] Setting key cc26f45158881570bc056dae50939caf
Aug 09 23:19:12 dist-test-slave-6nmv krb5kdc[4626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317552, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:12.697924 4720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:12.688432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:46863 (local address 127.1.235.190:46873)
0809 23:19:12.688503 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:12.688506 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:12.688655 (+ 149us) server_negotiation.cc:407] Connection header received
0809 23:19:12.689280 (+ 625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:12.689282 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:12.689299 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:12.689352 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:12.690616 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:12.691080 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:12.692214 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:12.692542 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:12.692612 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:12.694941 (+ 2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:12.694942 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:12.694942 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:12.694949 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:12.696427 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:12.696935 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:12.696936 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:12.696937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:12.696999 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:12.697263 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:12.697264 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:12.697264 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:12.697358 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:12.697407 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:12.697740 (+ 333us) server_negotiation.cc:299] Negotiation successful
0809 23:19:12.697846 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 23:19:12.698156 4889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:12.688387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:46873 (local address 127.1.235.129:46863)
0809 23:19:12.688544 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:12.688584 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:12.689154 (+ 570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:12.689443 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:12.689446 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:12.690249 (+ 803us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:12.690513 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:12.690518 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:12.691179 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:12.691181 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:12.692123 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:12.692126 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:12.692627 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:12.692628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:12.692718 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:12.693181 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:12.693189 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:12.694820 (+ 1631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:12.696524 (+ 1704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:12.696533 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:12.696535 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:12.696853 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:12.697062 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:12.697063 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:12.697063 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:12.697194 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:12.697425 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:12.697433 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:12.697603 (+ 170us) client_negotiation.cc:769] Sending connection context
0809 23:19:12.697722 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 23:19:12.697927 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
I20260809 23:19:12.698611 4887 heartbeater.cc:347] Connected to a master server at 127.1.235.190:46873
I20260809 23:19:12.698696 4887 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:12.698887 4887 heartbeater.cc:511] Master 127.1.235.190:46873 requested a full tablet report, sending...
I20260809 23:19:12.699404 4675 ts_manager.cc:194] Registered new tserver with Master: 8cd6fc4586f34419a3ef9a058c62e620 (127.1.235.129:41237)
I20260809 23:19:12.700006 4675 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:46863
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:19:12.716545 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:46873
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:40289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:12.792436 4892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:12.792642 4892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:12.792680 4892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:12.793740 4892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:12.793810 4892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:12.793879 4892 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:19:12.795161 4892 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:40289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:46873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4892
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:12.795409 4892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:12.795598 4892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:12.800042 4897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:12.800217 4892 server_base.cc:1034] running on GCE node
W20260809 23:19:12.800072 4898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:12.800050 4900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:12.800487 4892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:12.800743 4892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:12.801865 4892 hybrid_clock.cc:648] HybridClock initialized: now 1786317552801845 us; error 41 us; skew 500 ppm
Aug 09 23:19:12 dist-test-slave-6nmv krb5kdc[4626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317552, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:12.804183 4892 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:19:12.804505 4892 webserver.cc:460] Webserver started at http://127.1.235.130:39071/ using document root <none> and password file <none>
I20260809 23:19:12.804701 4892 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:12.804741 4892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:12.804823 4892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:12.805706 4892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "79d968f92fb247b990599aa8dc35c831"
format_stamp: "Formatted at 2026-08-09 23:19:12 on dist-test-slave-6nmv"
server_key: "7630447ccaa7f83efc8e46acfd04b291"
server_key_iv: "093f4b0cdff508ca4e84b96ff9feaf34"
server_key_version: "encryptionkey@0"
I20260809 23:19:12.806150 4892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "79d968f92fb247b990599aa8dc35c831"
format_stamp: "Formatted at 2026-08-09 23:19:12 on dist-test-slave-6nmv"
server_key: "7630447ccaa7f83efc8e46acfd04b291"
server_key_iv: "093f4b0cdff508ca4e84b96ff9feaf34"
server_key_version: "encryptionkey@0"
I20260809 23:19:12.807360 4892 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:12.808034 4908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:12.808255 4892 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:12.808342 4892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "79d968f92fb247b990599aa8dc35c831"
format_stamp: "Formatted at 2026-08-09 23:19:12 on dist-test-slave-6nmv"
server_key: "7630447ccaa7f83efc8e46acfd04b291"
server_key_iv: "093f4b0cdff508ca4e84b96ff9feaf34"
server_key_version: "encryptionkey@0"
I20260809 23:19:12.808406 4892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:12.838172 4892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:12.839754 4892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:12.839910 4892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:12.840124 4892 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:12.840416 4892 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:12.840451 4892 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:12.840472 4892 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:12.840519 4892 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:12.845580 4892 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:40937
I20260809 23:19:12.845642 5036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:40937 every 8 connection(s)
I20260809 23:19:12.845924 4892 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:19:12.851168 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 4892
I20260809 23:19:12.851274 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:19:12.851464 1966 external_mini_cluster.cc:1428] Setting key 5c1a6e56e08dd214d6a46c86d72e98bb
Aug 09 23:19:12 dist-test-slave-6nmv krb5kdc[4626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317552, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:12.855062 5040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:12.846527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:46873 (local address 127.1.235.130:57735)
0809 23:19:12.846744 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:12.846776 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:12.847175 (+ 399us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:12.847368 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:12.847371 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:12.847936 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:12.848106 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:12.848109 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:12.848716 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:12.848717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:12.849461 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:12.849463 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:12.849780 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:12.849781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:12.849942 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:12.850418 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:12.850426 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:12.852031 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:12.853875 (+ 1844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:12.853881 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:12.853883 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:12.854073 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:12.854269 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:12.854269 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:12.854269 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:12.854357 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:12.854644 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:12.854648 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:12.854743 (+ 95us) client_negotiation.cc:769] Sending connection context
0809 23:19:12.854819 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 23:19:12.854926 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":108,"threads_started":1}
I20260809 23:19:12.855075 4720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:12.846569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:57735 (local address 127.1.235.190:46873)
0809 23:19:12.846638 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:12.846640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:12.846850 (+ 210us) server_negotiation.cc:407] Connection header received
0809 23:19:12.847250 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:12.847251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:12.847261 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:12.847318 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:12.848173 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:12.848643 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:12.849533 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:12.849710 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:12.849759 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:12.852146 (+ 2387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:12.852147 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:12.852147 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:12.852154 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:12.853754 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:12.854135 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:12.854136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:12.854136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:12.854202 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:12.854415 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:12.854416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:12.854416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:12.854565 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:12.854651 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:12.854860 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 23:19:12.854956 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 23:19:12.855624 5037 heartbeater.cc:347] Connected to a master server at 127.1.235.190:46873
I20260809 23:19:12.855726 5037 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:12.855908 5037 heartbeater.cc:511] Master 127.1.235.190:46873 requested a full tablet report, sending...
I20260809 23:19:12.856312 4675 ts_manager.cc:194] Registered new tserver with Master: 79d968f92fb247b990599aa8dc35c831 (127.1.235.130:40937)
I20260809 23:19:12.856809 4675 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:57735
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:19:12.876099 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:46873
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:40289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:12.950874 5043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:12.951043 5043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:12.951064 5043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:12.952142 5043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:12.952178 5043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:12.952203 5043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:19:12.953513 5043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:40289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:46873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:12.953733 5043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:12.953950 5043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:12.958281 5051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:12.958369 5043 server_base.cc:1034] running on GCE node
W20260809 23:19:12.958308 5048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:12.958382 5049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:12.958709 5043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:12.958971 5043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:12.960134 5043 hybrid_clock.cc:648] HybridClock initialized: now 1786317552960121 us; error 40 us; skew 500 ppm
Aug 09 23:19:12 dist-test-slave-6nmv krb5kdc[4626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317552, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:12.962466 5043 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:19:12.962879 5043 webserver.cc:460] Webserver started at http://127.1.235.131:33775/ using document root <none> and password file <none>
I20260809 23:19:12.963114 5043 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:12.963178 5043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:12.963318 5043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:12.964227 5043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "5e40658c5b6f4682a77a315cf316679f"
format_stamp: "Formatted at 2026-08-09 23:19:12 on dist-test-slave-6nmv"
server_key: "d80fe298b8d0c8af947baf49edf92a67"
server_key_iv: "323fe64edb7873fcbcc541daae5337d7"
server_key_version: "encryptionkey@0"
I20260809 23:19:12.964555 5043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "5e40658c5b6f4682a77a315cf316679f"
format_stamp: "Formatted at 2026-08-09 23:19:12 on dist-test-slave-6nmv"
server_key: "d80fe298b8d0c8af947baf49edf92a67"
server_key_iv: "323fe64edb7873fcbcc541daae5337d7"
server_key_version: "encryptionkey@0"
I20260809 23:19:12.965720 5043 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:19:12.966379 5058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:12.966527 5043 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:12.966615 5043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "5e40658c5b6f4682a77a315cf316679f"
format_stamp: "Formatted at 2026-08-09 23:19:12 on dist-test-slave-6nmv"
server_key: "d80fe298b8d0c8af947baf49edf92a67"
server_key_iv: "323fe64edb7873fcbcc541daae5337d7"
server_key_version: "encryptionkey@0"
I20260809 23:19:12.966687 5043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:12.979691 5043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:12.981863 5043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:12.982008 5043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:12.982205 5043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:12.982463 5043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:12.982514 5043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:12.982549 5043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:12.982575 5043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:12.987790 5043 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:34871
I20260809 23:19:12.987839 5179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:34871 every 8 connection(s)
I20260809 23:19:12.988099 5043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:19:12.990340 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 5043
I20260809 23:19:12.990450 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:19:12.990662 1966 external_mini_cluster.cc:1428] Setting key f225c8b292fae285be518563c7d3004d
Aug 09 23:19:12 dist-test-slave-6nmv krb5kdc[4626](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317552, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:12.996574 4720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:12.988667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:47553 (local address 127.1.235.190:46873)
0809 23:19:12.988707 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:12.988709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:12.988883 (+ 174us) server_negotiation.cc:407] Connection header received
0809 23:19:12.989319 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:12.989319 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:12.989328 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:12.989399 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:12.990355 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:12.991065 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:12.992206 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:12.992387 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:12.992443 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:12.994497 (+ 2054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:12.994498 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:12.994498 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:12.994504 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:12.995572 (+ 1068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:12.995888 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:12.995888 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:12.995889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:12.995933 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:12.996128 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:12.996129 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:12.996129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:12.996214 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:12.996260 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:12.996461 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 23:19:12.996515 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 23:19:12.996783 5183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:12.988623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:46873 (local address 127.1.235.131:47553)
0809 23:19:12.988767 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:12.988802 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:12.989238 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:12.989476 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:12.989479 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:12.990083 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:12.990261 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:12.990265 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:12.991198 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:12.991199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:12.992133 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:12.992135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:12.992463 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:12.992464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:12.992566 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:12.993064 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:12.993071 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:12.994422 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:12.995636 (+ 1214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:12.995642 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:12.995643 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:12.995829 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:12.995984 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:12.995985 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:12.995985 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:12.996071 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:12.996265 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:12.996268 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:12.996363 (+ 95us) client_negotiation.cc:769] Sending connection context
0809 23:19:12.996435 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 23:19:12.996537 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
I20260809 23:19:12.997211 5180 heartbeater.cc:347] Connected to a master server at 127.1.235.190:46873
I20260809 23:19:12.997280 5180 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:12.997400 5180 heartbeater.cc:511] Master 127.1.235.190:46873 requested a full tablet report, sending...
I20260809 23:19:12.997720 4675 ts_manager.cc:194] Registered new tserver with Master: 5e40658c5b6f4682a77a315cf316679f (127.1.235.131:34871)
I20260809 23:19:12.998080 4675 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:47553
I20260809 23:19:13.002138 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 23:19:13.013072 4720 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:19:13.012268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55372 (local address 127.1.235.190:46873)
0809 23:19:13.012326 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:13.012328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:13.012448 (+ 120us) server_negotiation.cc:407] Connection header received
0809 23:19:13.012497 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:13.012499 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:13.012509 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:13.012568 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:13.013007 (+ 439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55372: BlockingRecv error: recv got EOF from 127.0.0.1:55372 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 23:19:13.013808 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 4744
I20260809 23:19:13.022627 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 4892
I20260809 23:19:13.031589 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 5043
I20260809 23:19:13.036525 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 4641
2026-08-09T23:19:13Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1792 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:19:13 dist-test-slave-6nmv krb5kdc[5195](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:19:13 dist-test-slave-6nmv krb5kdc[5195](info): set up 2 sockets
Aug 09 23:19:13 dist-test-slave-6nmv krb5kdc[5195](info): commencing operation
krb5kdc: starting...
W20260809 23:19:14.070482 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:19:14 dist-test-slave-6nmv krb5kdc[5195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:19:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:19:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:19:14.182473 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:42291
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:43193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:42291
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:14.258216 5209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:14.258399 5209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:14.258421 5209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:14.259443 5209 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:14.259495 5209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:14.259508 5209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:14.259521 5209 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:14.259533 5209 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:19:14.260914 5209 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:43193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:42291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:42291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5209
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:14.261101 5209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:14.261260 5209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:14.265758 5214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:14.265738 5217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:14.265738 5215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:14.265784 5209 server_base.cc:1034] running on GCE node
I20260809 23:19:14.266175 5209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:14.266460 5209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:14.267601 5209 hybrid_clock.cc:648] HybridClock initialized: now 1786317554267593 us; error 29 us; skew 500 ppm
Aug 09 23:19:14 dist-test-slave-6nmv krb5kdc[5195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317554, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:14.269963 5209 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:19:14.270421 5209 webserver.cc:460] Webserver started at http://127.1.235.190:43439/ using document root <none> and password file <none>
I20260809 23:19:14.270649 5209 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:14.270738 5209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:14.270864 5209 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:14.271900 5209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "df7c2cec84d0432bbec099c9479fcacb"
format_stamp: "Formatted at 2026-08-09 23:19:14 on dist-test-slave-6nmv"
server_key: "99fabece0967408b0efce7ef6dbf7610"
server_key_iv: "55aad60f97bfd03a6e8d29c4f65703fc"
server_key_version: "encryptionkey@0"
I20260809 23:19:14.272260 5209 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "df7c2cec84d0432bbec099c9479fcacb"
format_stamp: "Formatted at 2026-08-09 23:19:14 on dist-test-slave-6nmv"
server_key: "99fabece0967408b0efce7ef6dbf7610"
server_key_iv: "55aad60f97bfd03a6e8d29c4f65703fc"
server_key_version: "encryptionkey@0"
I20260809 23:19:14.273567 5209 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:19:14.274315 5225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:14.274482 5209 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:14.274571 5209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "df7c2cec84d0432bbec099c9479fcacb"
format_stamp: "Formatted at 2026-08-09 23:19:14 on dist-test-slave-6nmv"
server_key: "99fabece0967408b0efce7ef6dbf7610"
server_key_iv: "55aad60f97bfd03a6e8d29c4f65703fc"
server_key_version: "encryptionkey@0"
I20260809 23:19:14.274658 5209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:14.290426 5209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:14.292124 5209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:14.292299 5209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:14.296485 5209 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:42291
I20260809 23:19:14.296576 5280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:42291 every 8 connection(s)
I20260809 23:19:14.296893 5209 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:19:14.297689 5281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:14.299804 5281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb: Bootstrap starting.
I20260809 23:19:14.300391 5281 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:14.300691 5281 log.cc:824] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:14.301328 5281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb: No bootstrap required, opened a new log
I20260809 23:19:14.302937 5281 raft_consensus.cc:348] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7c2cec84d0432bbec099c9479fcacb" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 42291 } }
I20260809 23:19:14.303068 5281 raft_consensus.cc:374] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:14.303092 5281 raft_consensus.cc:729] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df7c2cec84d0432bbec099c9479fcacb, State: Initialized, Role: FOLLOWER
I20260809 23:19:14.303211 5281 consensus_queue.cc:260] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7c2cec84d0432bbec099c9479fcacb" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 42291 } }
I20260809 23:19:14.303287 5281 raft_consensus.cc:388] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:19:14.303309 5281 raft_consensus.cc:482] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:19:14.303339 5281 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:14.304067 5281 raft_consensus.cc:504] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7c2cec84d0432bbec099c9479fcacb" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 42291 } }
I20260809 23:19:14.304148 5281 leader_election.cc:302] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df7c2cec84d0432bbec099c9479fcacb; no voters:
I20260809 23:19:14.304263 5281 leader_election.cc:288] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:19:14.304322 5284 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:14.304519 5284 raft_consensus.cc:686] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [term 1 LEADER]: Becoming Leader. State: Replica: df7c2cec84d0432bbec099c9479fcacb, State: Running, Role: LEADER
I20260809 23:19:14.304548 5281 sys_catalog.cc:564] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:14.304679 5284 consensus_queue.cc:237] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7c2cec84d0432bbec099c9479fcacb" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 42291 } }
I20260809 23:19:14.305074 5285 sys_catalog.cc:455] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df7c2cec84d0432bbec099c9479fcacb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7c2cec84d0432bbec099c9479fcacb" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 42291 } } }
I20260809 23:19:14.305115 5286 sys_catalog.cc:455] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [sys.catalog]: SysCatalogTable state changed. Reason: New leader df7c2cec84d0432bbec099c9479fcacb. Latest consensus state: current_term: 1 leader_uuid: "df7c2cec84d0432bbec099c9479fcacb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df7c2cec84d0432bbec099c9479fcacb" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 42291 } } }
I20260809 23:19:14.305258 5286 sys_catalog.cc:458] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:14.305461 5285 sys_catalog.cc:458] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:14.305660 5294 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:19:14.306180 5294 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:19:14.306802 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 5209
I20260809 23:19:14.306903 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:19:14.307096 1966 external_mini_cluster.cc:1428] Setting key b3d094e4234d6aa124d6cdc547955c3a
I20260809 23:19:14.307781 5294 catalog_manager.cc:1347] Generated new cluster ID: 3157fceaa3fe4d74becec375e5a4a2c7
I20260809 23:19:14.307854 5294 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 23:19:14 dist-test-slave-6nmv krb5kdc[5195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:14.315043 5294 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:19:14.315737 5294 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:19:14.318704 5306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:14.307562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57640 (local address 127.1.235.190:42291)
0809 23:19:14.307714 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:14.307723 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:14.307958 (+ 235us) server_negotiation.cc:407] Connection header received
0809 23:19:14.308095 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:14.308101 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:14.308150 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:14.308271 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:14.309018 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:14.310405 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:14.311466 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:14.312094 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:14.312190 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:14.315003 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:14.315007 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:14.315007 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:14.315018 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:14.316935 (+ 1917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:14.317283 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:14.317286 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:14.317286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:14.317372 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:14.317547 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:14.317548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:14.317548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:14.317774 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:14.317928 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:14.318353 (+ 425us) server_negotiation.cc:299] Negotiation successful
0809 23:19:14.318486 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":66,"threads_started":1}
I20260809 23:19:14.319685 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:19:14.322036 5294 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df7c2cec84d0432bbec099c9479fcacb: Generated new TSK 0
I20260809 23:19:14.322198 5294 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:19:14.344318 5306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:14.340822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57646 (local address 127.1.235.190:42291)
0809 23:19:14.340879 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:14.340881 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:14.340962 (+ 81us) server_negotiation.cc:407] Connection header received
0809 23:19:14.341003 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:14.341004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:14.341013 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:14.341085 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:14.341404 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:14.342219 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:14.342868 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:14.343187 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:14.343254 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:14.343867 (+ 613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:14.343868 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:14.343869 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:19:14.344094 (+ 225us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:14.344110 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:19:14.344117 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:14.344173 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:14.344223 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 23:19:14.344246 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 23:19:14.346743 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 5209
2026-08-09T23:19:14Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1308 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:19:14 dist-test-slave-6nmv krb5kdc[5318](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:19:14 dist-test-slave-6nmv krb5kdc[5318](info): set up 2 sockets
Aug 09 23:19:14 dist-test-slave-6nmv krb5kdc[5318](info): commencing operation
krb5kdc: starting...
W20260809 23:19:15.396600 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:19:15 dist-test-slave-6nmv krb5kdc[5318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:19:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:19:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:19:15.506655 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:32927
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:43975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:32927
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:15.583034 5334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:15.583242 5334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:15.583276 5334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:15.584275 5334 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:15.584333 5334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:15.584353 5334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:15.584371 5334 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:15.584398 5334 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:19:15.585636 5334 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:43975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:32927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:32927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:15.585893 5334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:15.586095 5334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:15.590380 5341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:15.590351 5343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:15.590492 5334 server_base.cc:1034] running on GCE node
W20260809 23:19:15.590696 5340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:15.590971 5334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:15.591255 5334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:15.592397 5334 hybrid_clock.cc:648] HybridClock initialized: now 1786317555592388 us; error 33 us; skew 500 ppm
Aug 09 23:19:15 dist-test-slave-6nmv krb5kdc[5318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317555, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:15.599239 5334 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:19:15.599699 5334 webserver.cc:460] Webserver started at http://127.1.235.190:34907/ using document root <none> and password file <none>
I20260809 23:19:15.599876 5334 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:15.599915 5334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:15.599998 5334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:15.601059 5334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "32dd7097bfee4bc3ae50b8c4730a2223"
format_stamp: "Formatted at 2026-08-09 23:19:15 on dist-test-slave-6nmv"
server_key: "b9f47d9364a1040f35bb6e0de3ee52a6"
server_key_iv: "61a05a71026fdfcdd8f1b324b3fedffc"
server_key_version: "encryptionkey@0"
I20260809 23:19:15.601336 5334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "32dd7097bfee4bc3ae50b8c4730a2223"
format_stamp: "Formatted at 2026-08-09 23:19:15 on dist-test-slave-6nmv"
server_key: "b9f47d9364a1040f35bb6e0de3ee52a6"
server_key_iv: "61a05a71026fdfcdd8f1b324b3fedffc"
server_key_version: "encryptionkey@0"
I20260809 23:19:15.602584 5334 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:19:15.603183 5350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:15.603360 5334 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:15.603440 5334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "32dd7097bfee4bc3ae50b8c4730a2223"
format_stamp: "Formatted at 2026-08-09 23:19:15 on dist-test-slave-6nmv"
server_key: "b9f47d9364a1040f35bb6e0de3ee52a6"
server_key_iv: "61a05a71026fdfcdd8f1b324b3fedffc"
server_key_version: "encryptionkey@0"
I20260809 23:19:15.603529 5334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:15.622956 5334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:15.624563 5334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:15.624703 5334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:15.628593 5334 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:32927
I20260809 23:19:15.628655 5406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:32927 every 8 connection(s)
I20260809 23:19:15.628926 5334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:19:15.630052 5407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:15.630563 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 5334
I20260809 23:19:15.630684 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:19:15.630882 1966 external_mini_cluster.cc:1428] Setting key 93de57b94e8b2e251f914427c9c4788c
I20260809 23:19:15.632800 5407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223: Bootstrap starting.
I20260809 23:19:15.633438 5407 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:15.633744 5407 log.cc:824] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:15.634343 5407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223: No bootstrap required, opened a new log
I20260809 23:19:15.636441 5407 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32dd7097bfee4bc3ae50b8c4730a2223" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 32927 } }
I20260809 23:19:15.636583 5407 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:15.636634 5407 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32dd7097bfee4bc3ae50b8c4730a2223, State: Initialized, Role: FOLLOWER
I20260809 23:19:15.636766 5407 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32dd7097bfee4bc3ae50b8c4730a2223" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 32927 } }
I20260809 23:19:15.636833 5407 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:19:15.636853 5407 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:19:15.636911 5407 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [term 0 FOLLOWER]: Advancing to term 1
Aug 09 23:19:15 dist-test-slave-6nmv krb5kdc[5318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:15.637418 5407 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32dd7097bfee4bc3ae50b8c4730a2223" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 32927 } }
I20260809 23:19:15.637535 5407 leader_election.cc:302] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32dd7097bfee4bc3ae50b8c4730a2223; no voters:
I20260809 23:19:15.637729 5407 leader_election.cc:288] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:19:15.637763 5413 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:15.637883 5413 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [term 1 LEADER]: Becoming Leader. State: Replica: 32dd7097bfee4bc3ae50b8c4730a2223, State: Running, Role: LEADER
I20260809 23:19:15.638008 5407 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:15.638244 5413 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32dd7097bfee4bc3ae50b8c4730a2223" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 32927 } }
I20260809 23:19:15.639119 5414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32dd7097bfee4bc3ae50b8c4730a2223" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32dd7097bfee4bc3ae50b8c4730a2223" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 32927 } } }
I20260809 23:19:15.639211 5414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:15.639494 5427 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:19:15.639614 5416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32dd7097bfee4bc3ae50b8c4730a2223. Latest consensus state: current_term: 1 leader_uuid: "32dd7097bfee4bc3ae50b8c4730a2223" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32dd7097bfee4bc3ae50b8c4730a2223" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 32927 } } }
I20260809 23:19:15.639791 5416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:15.640062 5427 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:19:15.641170 5411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:15.631319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48342 (local address 127.1.235.190:32927)
0809 23:19:15.631530 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:15.631538 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:15.631575 (+ 37us) server_negotiation.cc:407] Connection header received
0809 23:19:15.632089 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:15.632097 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:15.632153 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:15.632283 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:15.632850 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:15.634064 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:15.634746 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:15.635315 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:15.635414 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:15.637609 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:15.637613 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:15.637613 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:15.637624 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:15.639612 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:15.640036 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:15.640038 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:15.640038 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:15.640150 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:15.640352 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:15.640353 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:15.640354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:15.640579 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:15.640728 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:15.640868 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 23:19:15.640991 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":61,"threads_started":1}
I20260809 23:19:15.641605 5427 catalog_manager.cc:1347] Generated new cluster ID: 8cb02607df1e4364a9006c503bc80752
I20260809 23:19:15.641652 5427 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:19:15.649750 5427 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:19:15.650252 5427 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:19:15.655803 5427 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32dd7097bfee4bc3ae50b8c4730a2223: Generated new TSK 0
I20260809 23:19:15.655964 5427 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:19:15.688477 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:32927
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:43975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:15.780992 5438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:15.781175 5438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:15.781198 5438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:15.782371 5438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:15.782414 5438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:15.782441 5438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:19:15.783815 5438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:43975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:32927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:15.784037 5438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:15.784289 5438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:15.789108 5446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:15.789137 5444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:15.789132 5443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:15.789256 5438 server_base.cc:1034] running on GCE node
I20260809 23:19:15.789481 5438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:15.789845 5438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:15.791057 5438 hybrid_clock.cc:648] HybridClock initialized: now 1786317555791040 us; error 29 us; skew 500 ppm
Aug 09 23:19:15 dist-test-slave-6nmv krb5kdc[5318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317555, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:15.793433 5438 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:19:15.793900 5438 webserver.cc:460] Webserver started at http://127.1.235.129:46389/ using document root <none> and password file <none>
I20260809 23:19:15.794133 5438 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:15.794200 5438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:15.794353 5438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:15.795424 5438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "c7c88ebe5bee4fd3b23f6542963f7cfd"
format_stamp: "Formatted at 2026-08-09 23:19:15 on dist-test-slave-6nmv"
server_key: "26e2b96fbd30d151ee2f9fed6d30e7ec"
server_key_iv: "529717a2e2c24a7226cf07ad8dcff241"
server_key_version: "encryptionkey@0"
I20260809 23:19:15.795872 5438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "c7c88ebe5bee4fd3b23f6542963f7cfd"
format_stamp: "Formatted at 2026-08-09 23:19:15 on dist-test-slave-6nmv"
server_key: "26e2b96fbd30d151ee2f9fed6d30e7ec"
server_key_iv: "529717a2e2c24a7226cf07ad8dcff241"
server_key_version: "encryptionkey@0"
I20260809 23:19:15.797160 5438 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:19:15.797873 5453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:15.798064 5438 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 23:19:15.798147 5438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "c7c88ebe5bee4fd3b23f6542963f7cfd"
format_stamp: "Formatted at 2026-08-09 23:19:15 on dist-test-slave-6nmv"
server_key: "26e2b96fbd30d151ee2f9fed6d30e7ec"
server_key_iv: "529717a2e2c24a7226cf07ad8dcff241"
server_key_version: "encryptionkey@0"
I20260809 23:19:15.798202 5438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:15.823050 5438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:15.824736 5438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:15.824839 5438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:15.825006 5438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:15.825235 5438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:15.825265 5438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:15.825284 5438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:15.825296 5438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:15.830890 5438 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:45843
I20260809 23:19:15.830932 5577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:45843 every 8 connection(s)
I20260809 23:19:15.831246 5438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:19:15.833921 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 5438
I20260809 23:19:15.834000 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:19:15.834196 1966 external_mini_cluster.cc:1428] Setting key 0cc89345971afb7bc405b5c7471acdc6
Aug 09 23:19:15 dist-test-slave-6nmv krb5kdc[5318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317555, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:15.841670 5411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:15.831941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:57425 (local address 127.1.235.190:32927)
0809 23:19:15.832021 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:15.832023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:15.832183 (+ 160us) server_negotiation.cc:407] Connection header received
0809 23:19:15.832668 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:15.832669 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:15.832679 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:15.832730 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:15.833568 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:15.834202 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:15.835687 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:15.835866 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:15.835916 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:15.838578 (+ 2662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:15.838580 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:15.838580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:15.838588 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:15.840229 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:15.840648 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:15.840649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:15.840650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:15.840709 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:15.840970 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:15.840971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:15.840971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:15.841102 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:15.841168 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:15.841457 (+ 289us) server_negotiation.cc:299] Negotiation successful
0809 23:19:15.841547 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 23:19:15.841907 5581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:15.831884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:32927 (local address 127.1.235.129:57425)
0809 23:19:15.832069 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:15.832104 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:15.832582 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:15.832783 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:15.832786 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:15.833320 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:15.833498 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:15.833502 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:15.834311 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:15.834312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:15.835573 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:15.835577 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:15.835943 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:15.835944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:15.836083 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:15.836523 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:15.836532 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:15.838458 (+ 1926us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:15.840314 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:15.840322 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:15.840324 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:15.840555 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:15.840789 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:15.840790 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:15.840791 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:15.840906 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:15.841171 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:15.841178 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:15.841326 (+ 148us) client_negotiation.cc:769] Sending connection context
0809 23:19:15.841424 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 23:19:15.841639 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":91,"threads_started":1}
I20260809 23:19:15.842376 5579 heartbeater.cc:347] Connected to a master server at 127.1.235.190:32927
I20260809 23:19:15.842473 5579 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:15.842648 5579 heartbeater.cc:511] Master 127.1.235.190:32927 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
I20260809 23:19:15.843179 5366 ts_manager.cc:194] Registered new tserver with Master: c7c88ebe5bee4fd3b23f6542963f7cfd (127.1.235.129:45843)
I20260809 23:19:15.843734 5366 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:57425
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:19:15.860088 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:32927
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:43975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:15.938197 5585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:15.938450 5585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:15.938481 5585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:15.939724 5585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:15.939766 5585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:15.939817 5585 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:19:15.941198 5585 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:43975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:32927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:15.941422 5585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:15.941623 5585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:15.946414 5594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:15.946411 5591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:15.946419 5592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:15.946499 5585 server_base.cc:1034] running on GCE node
I20260809 23:19:15.946810 5585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:15.947037 5585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:15.948215 5585 hybrid_clock.cc:648] HybridClock initialized: now 1786317555948196 us; error 36 us; skew 500 ppm
Aug 09 23:19:15 dist-test-slave-6nmv krb5kdc[5318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317555, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:15.950748 5585 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:19:15.951211 5585 webserver.cc:460] Webserver started at http://127.1.235.130:32975/ using document root <none> and password file <none>
I20260809 23:19:15.951419 5585 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:15.951489 5585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:15.951673 5585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:15.952677 5585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "43a2d542d1fd49d9be019c77e52f31d5"
format_stamp: "Formatted at 2026-08-09 23:19:15 on dist-test-slave-6nmv"
server_key: "9b95fe7f87ad43f60004809500e13bf5"
server_key_iv: "06442f8388994a04a7c5c19fbf3e0133"
server_key_version: "encryptionkey@0"
I20260809 23:19:15.953048 5585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "43a2d542d1fd49d9be019c77e52f31d5"
format_stamp: "Formatted at 2026-08-09 23:19:15 on dist-test-slave-6nmv"
server_key: "9b95fe7f87ad43f60004809500e13bf5"
server_key_iv: "06442f8388994a04a7c5c19fbf3e0133"
server_key_version: "encryptionkey@0"
I20260809 23:19:15.954440 5585 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 23:19:15.955135 5602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:15.955298 5585 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:15.955391 5585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "43a2d542d1fd49d9be019c77e52f31d5"
format_stamp: "Formatted at 2026-08-09 23:19:15 on dist-test-slave-6nmv"
server_key: "9b95fe7f87ad43f60004809500e13bf5"
server_key_iv: "06442f8388994a04a7c5c19fbf3e0133"
server_key_version: "encryptionkey@0"
I20260809 23:19:15.955466 5585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:15.982239 5585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:15.983862 5585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:15.984002 5585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:15.984192 5585 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:15.984447 5585 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:15.984494 5585 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:15.984527 5585 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:15.984549 5585 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:15.990274 5585 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:33015
I20260809 23:19:15.990319 5724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:33015 every 8 connection(s)
I20260809 23:19:15.990608 5585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:19:15.994465 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 5585
I20260809 23:19:15.994576 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:19:15.994781 1966 external_mini_cluster.cc:1428] Setting key b1bfd455ad8769dc2a2eaabf2acb11df
Aug 09 23:19:15 dist-test-slave-6nmv krb5kdc[5318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317555, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:16.000036 5411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:15.991252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:60435 (local address 127.1.235.190:32927)
0809 23:19:15.991316 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:15.991318 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:15.991536 (+ 218us) server_negotiation.cc:407] Connection header received
0809 23:19:15.992032 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:15.992034 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:15.992047 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:15.992097 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:15.993002 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:15.993523 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:15.994583 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:15.994799 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:15.994878 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:15.997056 (+ 2178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:15.997058 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:15.997058 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:15.997067 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:15.998599 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:15.999089 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:15.999089 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:15.999090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:15.999141 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:15.999406 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:15.999407 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:15.999407 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:15.999504 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:15.999554 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:15.999900 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 23:19:15.999966 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 23:19:16.000309 5727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:15.991232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:32927 (local address 127.1.235.130:60435)
0809 23:19:15.991417 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:15.991449 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:15.991922 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:15.992175 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:15.992178 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:15.992721 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:15.992904 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:15.992909 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:15.993612 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:15.993613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:15.994467 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:15.994470 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:15.994933 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:15.994934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:15.995026 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:15.995523 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:15.995530 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:15.996891 (+ 1361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:15.998688 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:15.998694 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:15.998696 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:15.999010 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:15.999200 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:15.999201 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:15.999202 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:15.999339 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:15.999569 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:15.999575 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:15.999759 (+ 184us) client_negotiation.cc:769] Sending connection context
0809 23:19:15.999883 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 23:19:16.000071 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":78,"threads_started":1}
I20260809 23:19:16.000816 5725 heartbeater.cc:347] Connected to a master server at 127.1.235.190:32927
I20260809 23:19:16.000931 5725 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:16.001142 5725 heartbeater.cc:511] Master 127.1.235.190:32927 requested a full tablet report, sending...
I20260809 23:19:16.001529 5366 ts_manager.cc:194] Registered new tserver with Master: 43a2d542d1fd49d9be019c77e52f31d5 (127.1.235.130:33015)
I20260809 23:19:16.002077 5366 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:60435
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:19:16.021420 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:32927
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:43975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:16.099485 5731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:16.099743 5731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:16.099784 5731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:16.100992 5731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:16.101049 5731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:16.101089 5731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:19:16.102451 5731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:43975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:32927
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:16.102679 5731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:16.102891 5731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:16.107522 5739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:16.107550 5736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:16.107589 5731 server_base.cc:1034] running on GCE node
W20260809 23:19:16.107548 5737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:16.107897 5731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:16.108125 5731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:16.109292 5731 hybrid_clock.cc:648] HybridClock initialized: now 1786317556109291 us; error 43 us; skew 500 ppm
Aug 09 23:19:16 dist-test-slave-6nmv krb5kdc[5318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317556, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:16.111671 5731 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:19:16.112067 5731 webserver.cc:460] Webserver started at http://127.1.235.131:41449/ using document root <none> and password file <none>
I20260809 23:19:16.112305 5731 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:16.112373 5731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:16.112517 5731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:16.113440 5731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "849ce3c5c0534414babbfd13ef70f4e3"
format_stamp: "Formatted at 2026-08-09 23:19:16 on dist-test-slave-6nmv"
server_key: "5b704beac842d12e072fc88e291f9042"
server_key_iv: "b2922696540265233dd048ecab6fff73"
server_key_version: "encryptionkey@0"
I20260809 23:19:16.113785 5731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "849ce3c5c0534414babbfd13ef70f4e3"
format_stamp: "Formatted at 2026-08-09 23:19:16 on dist-test-slave-6nmv"
server_key: "5b704beac842d12e072fc88e291f9042"
server_key_iv: "b2922696540265233dd048ecab6fff73"
server_key_version: "encryptionkey@0"
I20260809 23:19:16.115037 5731 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:16.115737 5746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:16.115914 5731 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:16.115999 5731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "849ce3c5c0534414babbfd13ef70f4e3"
format_stamp: "Formatted at 2026-08-09 23:19:16 on dist-test-slave-6nmv"
server_key: "5b704beac842d12e072fc88e291f9042"
server_key_iv: "b2922696540265233dd048ecab6fff73"
server_key_version: "encryptionkey@0"
I20260809 23:19:16.116073 5731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:16.127269 5731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:16.128898 5731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:16.129055 5731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:16.129271 5731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:16.129562 5731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:16.129618 5731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:16.129666 5731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:16.129698 5731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:16.135268 5731 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:44211
I20260809 23:19:16.135327 5867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:44211 every 8 connection(s)
I20260809 23:19:16.135609 5731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:19:16.135939 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 5731
I20260809 23:19:16.136061 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:19:16.136242 1966 external_mini_cluster.cc:1428] Setting key 715a61c0e268fb042d05e2a40335ba68
Aug 09 23:19:16 dist-test-slave-6nmv krb5kdc[5318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317556, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:16.144284 5411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:16.136403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:57901 (local address 127.1.235.190:32927)
0809 23:19:16.136454 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:16.136456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:16.136744 (+ 288us) server_negotiation.cc:407] Connection header received
0809 23:19:16.137243 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:16.137244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:16.137261 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:16.137306 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:16.138219 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:16.138681 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:16.139748 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:16.139936 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:16.139993 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:16.141941 (+ 1948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:16.141942 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:16.141942 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:16.141948 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:16.143238 (+ 1290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:16.143586 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:16.143587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:16.143594 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:16.143642 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:16.143841 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:16.143842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:16.143842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:16.143934 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:16.143981 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:16.144170 (+ 189us) server_negotiation.cc:299] Negotiation successful
0809 23:19:16.144227 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 23:19:16.144433 5870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:16.136369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:32927 (local address 127.1.235.131:57901)
0809 23:19:16.136543 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:16.136585 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:16.137166 (+ 581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:16.137351 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:16.137355 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:16.137911 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:16.138146 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:16.138150 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:16.138778 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:16.138779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:16.139665 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:16.139668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:16.140008 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:16.140009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:16.140105 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:16.140494 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:16.140502 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:16.141868 (+ 1366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:16.143309 (+ 1441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:16.143315 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:16.143316 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:16.143513 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:16.143706 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:16.143707 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:16.143707 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:16.143792 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:16.143982 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:16.143986 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:16.144075 (+ 89us) client_negotiation.cc:769] Sending connection context
0809 23:19:16.144145 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 23:19:16.144246 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":87,"threads_started":1}
I20260809 23:19:16.144863 5868 heartbeater.cc:347] Connected to a master server at 127.1.235.190:32927
I20260809 23:19:16.144930 5868 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:16.145124 5868 heartbeater.cc:511] Master 127.1.235.190:32927 requested a full tablet report, sending...
I20260809 23:19:16.145483 5366 ts_manager.cc:194] Registered new tserver with Master: 849ce3c5c0534414babbfd13ef70f4e3 (127.1.235.131:44211)
I20260809 23:19:16.145874 5366 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:57901
I20260809 23:19:16.147933 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 23:19:16 dist-test-slave-6nmv krb5kdc[5318](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317556, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 23:19:16 dist-test-slave-6nmv krb5kdc[5318](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317556, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:16.169674 5411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:16.163381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48354 (local address 127.1.235.190:32927)
0809 23:19:16.163459 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:16.163461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:16.163556 (+ 95us) server_negotiation.cc:407] Connection header received
0809 23:19:16.163654 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:16.163655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:16.163665 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:16.163765 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:16.164281 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:16.164718 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:16.165399 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:16.165573 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:16.165652 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:16.167753 (+ 2101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:16.167755 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:16.167755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:16.167761 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:16.168800 (+ 1039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:16.169075 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:16.169075 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:16.169076 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:16.169123 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:16.169258 (+ 135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:16.169259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:16.169259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:16.169372 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:16.169439 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:16.169510 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 23:19:16.169585 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260809 23:19:16.169925 5366 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:48354
I20260809 23:19:16.170409 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 5438
I20260809 23:19:16.178933 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 5585
I20260809 23:19:16.185138 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 5731
I20260809 23:19:16.191241 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 5334
2026-08-09T23:19:16Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1847 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:19:16 dist-test-slave-6nmv krb5kdc[5881](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:19:16 dist-test-slave-6nmv krb5kdc[5881](info): set up 2 sockets
Aug 09 23:19:16 dist-test-slave-6nmv krb5kdc[5881](info): commencing operation
krb5kdc: starting...
W20260809 23:19:17.267590 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:19:17 dist-test-slave-6nmv krb5kdc[5881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:19:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:19:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:19:17.382130 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:39209
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:37017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:39209
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:17.464115 5894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:17.464311 5894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:17.464334 5894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:17.465373 5894 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:17.465411 5894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:17.465427 5894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:17.465441 5894 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:17.465456 5894 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:19:17.466874 5894 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:37017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:39209
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:39209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:17.467048 5894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:17.467217 5894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:17.471961 5902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:17.471944 5899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:17.472134 5894 server_base.cc:1034] running on GCE node
W20260809 23:19:17.471944 5900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:17.472442 5894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:17.472774 5894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:17.473863 5894 hybrid_clock.cc:648] HybridClock initialized: now 1786317557473851 us; error 30 us; skew 500 ppm
Aug 09 23:19:17 dist-test-slave-6nmv krb5kdc[5881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317557, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:17.476173 5894 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:19:17.476562 5894 webserver.cc:460] Webserver started at http://127.1.235.190:40147/ using document root <none> and password file <none>
I20260809 23:19:17.476756 5894 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:17.476816 5894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:17.476938 5894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:17.477864 5894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "262fff2fd8ab4a9fa7192ed74dc6fa8f"
format_stamp: "Formatted at 2026-08-09 23:19:17 on dist-test-slave-6nmv"
server_key: "eac01e55b635d7caf2eebbc6b9851283"
server_key_iv: "92ff7d35b6ae799db795543be2fe5d04"
server_key_version: "encryptionkey@0"
I20260809 23:19:17.478257 5894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "262fff2fd8ab4a9fa7192ed74dc6fa8f"
format_stamp: "Formatted at 2026-08-09 23:19:17 on dist-test-slave-6nmv"
server_key: "eac01e55b635d7caf2eebbc6b9851283"
server_key_iv: "92ff7d35b6ae799db795543be2fe5d04"
server_key_version: "encryptionkey@0"
I20260809 23:19:17.479447 5894 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:17.480221 5910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:17.480417 5894 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:17.480513 5894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "262fff2fd8ab4a9fa7192ed74dc6fa8f"
format_stamp: "Formatted at 2026-08-09 23:19:17 on dist-test-slave-6nmv"
server_key: "eac01e55b635d7caf2eebbc6b9851283"
server_key_iv: "92ff7d35b6ae799db795543be2fe5d04"
server_key_version: "encryptionkey@0"
I20260809 23:19:17.480608 5894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:17.496309 5894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:17.498034 5894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:17.498184 5894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:17.501953 5894 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:39209
I20260809 23:19:17.502017 5964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:39209 every 8 connection(s)
I20260809 23:19:17.502606 5894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:19:17.503388 5965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:17.505551 5965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f: Bootstrap starting.
I20260809 23:19:17.506160 5965 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:17.506376 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 5894
I20260809 23:19:17.506502 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:19:17.506560 5965 log.cc:824] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:17.506705 1966 external_mini_cluster.cc:1428] Setting key c0ea347f9c1ffde0d8c491ec93af38a9
I20260809 23:19:17.507387 5965 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f: No bootstrap required, opened a new log
I20260809 23:19:17.509366 5965 raft_consensus.cc:348] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "262fff2fd8ab4a9fa7192ed74dc6fa8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39209 } }
I20260809 23:19:17.509511 5965 raft_consensus.cc:374] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:17.509578 5965 raft_consensus.cc:729] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 262fff2fd8ab4a9fa7192ed74dc6fa8f, State: Initialized, Role: FOLLOWER
I20260809 23:19:17.509742 5965 consensus_queue.cc:260] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "262fff2fd8ab4a9fa7192ed74dc6fa8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39209 } }
I20260809 23:19:17.509869 5965 raft_consensus.cc:388] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:19:17.509907 5965 raft_consensus.cc:482] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:19:17.509955 5965 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:17.510478 5965 raft_consensus.cc:504] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "262fff2fd8ab4a9fa7192ed74dc6fa8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39209 } }
I20260809 23:19:17.510603 5965 leader_election.cc:302] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 262fff2fd8ab4a9fa7192ed74dc6fa8f; no voters:
I20260809 23:19:17.510776 5965 leader_election.cc:288] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:19:17.510816 5971 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:17.510982 5971 raft_consensus.cc:686] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [term 1 LEADER]: Becoming Leader. State: Replica: 262fff2fd8ab4a9fa7192ed74dc6fa8f, State: Running, Role: LEADER
I20260809 23:19:17.511049 5965 sys_catalog.cc:564] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:17.511193 5971 consensus_queue.cc:237] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "262fff2fd8ab4a9fa7192ed74dc6fa8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39209 } }
I20260809 23:19:17.512879 5974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "262fff2fd8ab4a9fa7192ed74dc6fa8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "262fff2fd8ab4a9fa7192ed74dc6fa8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39209 } } }
I20260809 23:19:17.513950 5974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:17.512985 5972 sys_catalog.cc:455] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 262fff2fd8ab4a9fa7192ed74dc6fa8f. Latest consensus state: current_term: 1 leader_uuid: "262fff2fd8ab4a9fa7192ed74dc6fa8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "262fff2fd8ab4a9fa7192ed74dc6fa8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39209 } } }
I20260809 23:19:17.514747 5972 sys_catalog.cc:458] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f [sys.catalog]: This master's current role is: LEADER
W20260809 23:19:17.513160 5988 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 23:19:17.514819 5988 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:19:17.514940 5990 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:19:17.515110 5990 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 23:19:17 dist-test-slave-6nmv krb5kdc[5881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:17.517594 5990 catalog_manager.cc:1347] Generated new cluster ID: 281c9fe889804d828c24f434667f74e7
I20260809 23:19:17.517644 5990 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:19:17.519605 5970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:17.507204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60210 (local address 127.1.235.190:39209)
0809 23:19:17.507376 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:17.507388 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:17.507595 (+ 207us) server_negotiation.cc:407] Connection header received
0809 23:19:17.509351 (+ 1756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:17.509357 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:17.509402 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:17.509533 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:17.510324 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:17.511629 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:17.512590 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:17.513171 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:17.513287 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:17.515866 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:17.515870 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:17.515870 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:17.515881 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:17.517977 (+ 2096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:17.518361 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:17.518363 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:17.518364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:17.518472 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:17.518755 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:17.518756 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:17.518756 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:17.519019 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:17.519154 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:17.519294 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 23:19:17.519414 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":91,"threads_started":1}
I20260809 23:19:17.524686 5990 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:19:17.525173 5990 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:19:17.530017 5990 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 262fff2fd8ab4a9fa7192ed74dc6fa8f: Generated new TSK 0
I20260809 23:19:17.530196 5990 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:19:17.554682 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39209
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:37017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:17.632419 5994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:17.632638 5994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:17.632673 5994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:17.633741 5994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:17.633805 5994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:17.633889 5994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:19:17.635200 5994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:37017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:17.635421 5994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:17.635617 5994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:17.640398 5999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:17.640420 6000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:17.640424 6002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:17.640612 5994 server_base.cc:1034] running on GCE node
I20260809 23:19:17.640880 5994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:17.641121 5994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:17.642282 5994 hybrid_clock.cc:648] HybridClock initialized: now 1786317557642267 us; error 28 us; skew 500 ppm
Aug 09 23:19:17 dist-test-slave-6nmv krb5kdc[5881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317557, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:17.644671 5994 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:19:17.645074 5994 webserver.cc:460] Webserver started at http://127.1.235.129:44665/ using document root <none> and password file <none>
I20260809 23:19:17.645293 5994 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:17.645360 5994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:17.645514 5994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:17.646498 5994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "e2bbed19507440cf8601cd17688fba36"
format_stamp: "Formatted at 2026-08-09 23:19:17 on dist-test-slave-6nmv"
server_key: "dd86877718434a55b8cc93bb7c72f76e"
server_key_iv: "8d140ad58acabc0e7b2d5ecbb68dc6e4"
server_key_version: "encryptionkey@0"
I20260809 23:19:17.646829 5994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "e2bbed19507440cf8601cd17688fba36"
format_stamp: "Formatted at 2026-08-09 23:19:17 on dist-test-slave-6nmv"
server_key: "dd86877718434a55b8cc93bb7c72f76e"
server_key_iv: "8d140ad58acabc0e7b2d5ecbb68dc6e4"
server_key_version: "encryptionkey@0"
I20260809 23:19:17.648185 5994 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 23:19:17.648844 6009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:17.649022 5994 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:19:17.649114 5994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "e2bbed19507440cf8601cd17688fba36"
format_stamp: "Formatted at 2026-08-09 23:19:17 on dist-test-slave-6nmv"
server_key: "dd86877718434a55b8cc93bb7c72f76e"
server_key_iv: "8d140ad58acabc0e7b2d5ecbb68dc6e4"
server_key_version: "encryptionkey@0"
I20260809 23:19:17.649184 5994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:17.657590 5994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:17.659286 5994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:17.659426 5994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:17.659655 5994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:17.659960 5994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:17.660017 5994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:17.660055 5994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:17.660084 5994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:17.665398 5994 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:33331
I20260809 23:19:17.665503 6134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:33331 every 8 connection(s)
I20260809 23:19:17.665752 5994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:19:17.669158 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 5994
I20260809 23:19:17.669291 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:19:17.669480 1966 external_mini_cluster.cc:1428] Setting key f7acad5d3269607f92e6b9915658dd44
Aug 09 23:19:17 dist-test-slave-6nmv krb5kdc[5881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317557, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:17.675792 5970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:17.666365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:36471 (local address 127.1.235.190:39209)
0809 23:19:17.666409 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:17.666411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:17.666569 (+ 158us) server_negotiation.cc:407] Connection header received
0809 23:19:17.667475 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:17.667477 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:17.667501 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:17.667556 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:17.668130 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:17.668731 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:17.669929 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:17.670260 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:17.670331 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:17.672995 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:17.672997 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:17.672997 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:17.673003 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:17.674241 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:17.674771 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:17.674772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:17.674772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:17.674846 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:17.675173 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:17.675173 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:17.675173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:17.675303 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:17.675355 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:17.675665 (+ 310us) server_negotiation.cc:299] Negotiation successful
0809 23:19:17.675732 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 23:19:17.676076 6138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:17.666324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39209 (local address 127.1.235.129:36471)
0809 23:19:17.666450 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:17.666489 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:17.667357 (+ 868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:17.667615 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:17.667619 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:17.667855 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:17.668030 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:17.668034 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:17.668837 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:17.668838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:17.669821 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:17.669824 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:17.670369 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:17.670370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:17.670526 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:17.670977 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:17.670987 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:17.672903 (+ 1916us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:17.674338 (+ 1435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:17.674345 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:17.674347 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:17.674688 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:17.674920 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:17.674921 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:17.674921 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:17.675101 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:17.675370 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:17.675378 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:17.675536 (+ 158us) client_negotiation.cc:769] Sending connection context
0809 23:19:17.675645 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 23:19:17.675811 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":62,"threads_started":1}
I20260809 23:19:17.676580 6135 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39209
I20260809 23:19:17.676676 6135 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:17.676856 6135 heartbeater.cc:511] Master 127.1.235.190:39209 requested a full tablet report, sending...
I20260809 23:19:17.677361 5928 ts_manager.cc:194] Registered new tserver with Master: e2bbed19507440cf8601cd17688fba36 (127.1.235.129:33331)
I20260809 23:19:17.677968 5928 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:36471
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:19:17.694389 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39209
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:37017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:17.773777 6141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:17.773962 6141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:17.773983 6141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:17.774988 6141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:17.775020 6141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:17.775045 6141 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:19:17.776273 6141 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:37017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:17.776425 6141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:17.776574 6141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:17.781049 6147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:17.781008 6146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:17.781051 6149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:17.781250 6141 server_base.cc:1034] running on GCE node
I20260809 23:19:17.781503 6141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:17.781760 6141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:17.782927 6141 hybrid_clock.cc:648] HybridClock initialized: now 1786317557782905 us; error 38 us; skew 500 ppm
Aug 09 23:19:17 dist-test-slave-6nmv krb5kdc[5881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317557, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:17.785279 6141 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:19:17.785693 6141 webserver.cc:460] Webserver started at http://127.1.235.130:43829/ using document root <none> and password file <none>
I20260809 23:19:17.785933 6141 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:17.785995 6141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:17.786152 6141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:17.787024 6141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "65cc4b0469a74c0191ac2fd632292e30"
format_stamp: "Formatted at 2026-08-09 23:19:17 on dist-test-slave-6nmv"
server_key: "b1ba50f30ef97f0ee8cb55aae1656556"
server_key_iv: "1bbd8683b3abb1c637fef79cb46ef359"
server_key_version: "encryptionkey@0"
I20260809 23:19:17.787352 6141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "65cc4b0469a74c0191ac2fd632292e30"
format_stamp: "Formatted at 2026-08-09 23:19:17 on dist-test-slave-6nmv"
server_key: "b1ba50f30ef97f0ee8cb55aae1656556"
server_key_iv: "1bbd8683b3abb1c637fef79cb46ef359"
server_key_version: "encryptionkey@0"
I20260809 23:19:17.788570 6141 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:19:17.789289 6156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:17.789471 6141 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:17.789569 6141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "65cc4b0469a74c0191ac2fd632292e30"
format_stamp: "Formatted at 2026-08-09 23:19:17 on dist-test-slave-6nmv"
server_key: "b1ba50f30ef97f0ee8cb55aae1656556"
server_key_iv: "1bbd8683b3abb1c637fef79cb46ef359"
server_key_version: "encryptionkey@0"
I20260809 23:19:17.789654 6141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:17.798848 6141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:17.800611 6141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:17.800766 6141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:17.800969 6141 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:17.801270 6141 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:17.801321 6141 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:17.801357 6141 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:17.801383 6141 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:17.806371 6141 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:43825
I20260809 23:19:17.806406 6280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:43825 every 8 connection(s)
I20260809 23:19:17.806675 6141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:19:17.808614 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 6141
I20260809 23:19:17.808697 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:19:17.808862 1966 external_mini_cluster.cc:1428] Setting key 9b907ad924d35524c2e17f80cb4f4f7c
Aug 09 23:19:17 dist-test-slave-6nmv krb5kdc[5881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317557, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:17.815822 6284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:17.807304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39209 (local address 127.1.235.130:37699)
0809 23:19:17.807435 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:17.807469 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:17.808203 (+ 734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:17.808377 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:17.808379 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:17.808578 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:17.808781 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:17.808786 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:17.809438 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:17.809439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:17.810308 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:17.810310 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:17.810825 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:17.810826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:17.810921 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:17.811392 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:17.811398 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:17.812832 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:17.814669 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:17.814674 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:17.814676 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:17.814863 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:17.815068 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:17.815069 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:17.815069 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:17.815153 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:17.815439 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:17.815442 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:17.815533 (+ 91us) client_negotiation.cc:769] Sending connection context
0809 23:19:17.815602 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 23:19:17.815698 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":74,"threads_started":1}
I20260809 23:19:17.815826 5970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:17.807341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:37699 (local address 127.1.235.190:39209)
0809 23:19:17.807402 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:17.807404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:17.807552 (+ 148us) server_negotiation.cc:407] Connection header received
0809 23:19:17.808277 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:17.808278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:17.808287 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:17.808330 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:17.808859 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:17.809351 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:17.810412 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:17.810749 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:17.810821 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:17.812927 (+ 2106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:17.812928 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:17.812929 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:17.812936 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:17.814570 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:17.814933 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:17.814935 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:17.814935 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:17.815000 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:17.815217 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:17.815217 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:17.815218 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:17.815363 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:17.815449 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:17.815650 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 23:19:17.815731 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 23:19:17.816435 6281 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39209
I20260809 23:19:17.816529 6281 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:17.816697 6281 heartbeater.cc:511] Master 127.1.235.190:39209 requested a full tablet report, sending...
I20260809 23:19:17.817031 5928 ts_manager.cc:194] Registered new tserver with Master: 65cc4b0469a74c0191ac2fd632292e30 (127.1.235.130:43825)
I20260809 23:19:17.817516 5928 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:37699
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:19:17.832806 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39209
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:37017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:17.908617 6287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:17.908777 6287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:17.908798 6287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:17.909754 6287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:17.909788 6287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:17.909878 6287 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:19:17.911444 6287 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:37017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39209
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6287
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:17.911644 6287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:17.911859 6287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:17.916471 6292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:17.916527 6293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:17.916464 6295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:17.916738 6287 server_base.cc:1034] running on GCE node
I20260809 23:19:17.916932 6287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:17.917116 6287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:17.918267 6287 hybrid_clock.cc:648] HybridClock initialized: now 1786317557918255 us; error 25 us; skew 500 ppm
Aug 09 23:19:17 dist-test-slave-6nmv krb5kdc[5881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317557, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:17.920710 6287 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:19:17.921126 6287 webserver.cc:460] Webserver started at http://127.1.235.131:35271/ using document root <none> and password file <none>
I20260809 23:19:17.921347 6287 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:17.921389 6287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:17.921540 6287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:17.922519 6287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "b3096d396c624fe99d7f59a2f8f11e71"
format_stamp: "Formatted at 2026-08-09 23:19:17 on dist-test-slave-6nmv"
server_key: "3273e7cba264f49a7a15f4f6c1f25795"
server_key_iv: "df67daef09353cfd48e205091c07fa68"
server_key_version: "encryptionkey@0"
I20260809 23:19:17.922878 6287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "b3096d396c624fe99d7f59a2f8f11e71"
format_stamp: "Formatted at 2026-08-09 23:19:17 on dist-test-slave-6nmv"
server_key: "3273e7cba264f49a7a15f4f6c1f25795"
server_key_iv: "df67daef09353cfd48e205091c07fa68"
server_key_version: "encryptionkey@0"
I20260809 23:19:17.924096 6287 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 23:19:17.924741 6302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:17.924907 6287 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:19:17.924966 6287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "b3096d396c624fe99d7f59a2f8f11e71"
format_stamp: "Formatted at 2026-08-09 23:19:17 on dist-test-slave-6nmv"
server_key: "3273e7cba264f49a7a15f4f6c1f25795"
server_key_iv: "df67daef09353cfd48e205091c07fa68"
server_key_version: "encryptionkey@0"
I20260809 23:19:17.925042 6287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:17.956717 6287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:17.958669 6287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:17.958830 6287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:17.959095 6287 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:17.959408 6287 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:17.959461 6287 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:17.959498 6287 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:17.959523 6287 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:17.965369 6287 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:46193
I20260809 23:19:17.965418 6426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:46193 every 8 connection(s)
I20260809 23:19:17.965709 6287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:19:17.966996 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 6287
I20260809 23:19:17.967126 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:19:17.967291 1966 external_mini_cluster.cc:1428] Setting key 1859cde1884edeb0503fdedcebd87dbf
Aug 09 23:19:17 dist-test-slave-6nmv krb5kdc[5881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317557, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:17.974447 5970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:17.966403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:32865 (local address 127.1.235.190:39209)
0809 23:19:17.966487 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:17.966489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:17.966700 (+ 211us) server_negotiation.cc:407] Connection header received
0809 23:19:17.967659 (+ 959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:17.967660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:17.967670 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:17.967726 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:17.968449 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:17.968959 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:17.969934 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:17.970115 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:17.970169 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:17.972199 (+ 2030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:17.972201 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:17.972201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:17.972208 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:17.973373 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:17.973724 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:17.973724 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:17.973725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:17.973771 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:17.973985 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:17.973986 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:17.973986 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:17.974081 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:17.974132 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:17.974331 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 23:19:17.974388 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 23:19:17.974632 6430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:17.966384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39209 (local address 127.1.235.131:32865)
0809 23:19:17.966577 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:17.966609 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:17.967569 (+ 960us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:17.967801 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:17.967806 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:17.968160 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:17.968358 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:17.968362 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:17.969034 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:17.969034 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:17.969777 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:17.969782 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:17.970185 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:17.970186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:17.970282 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:17.970797 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:17.970805 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:17.972123 (+ 1318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:17.973461 (+ 1338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:17.973467 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:17.973468 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:17.973664 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:17.973848 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:17.973849 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:17.973849 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:17.973935 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:17.974135 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:17.974138 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:17.974231 (+ 93us) client_negotiation.cc:769] Sending connection context
0809 23:19:17.974303 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 23:19:17.974405 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":105,"threads_started":1}
I20260809 23:19:17.975087 6427 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39209
I20260809 23:19:17.975179 6427 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:17.975334 6427 heartbeater.cc:511] Master 127.1.235.190:39209 requested a full tablet report, sending...
I20260809 23:19:17.975684 5928 ts_manager.cc:194] Registered new tserver with Master: b3096d396c624fe99d7f59a2f8f11e71 (127.1.235.131:46193)
I20260809 23:19:17.976014 5928 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:32865
I20260809 23:19:17.978714 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 23:19:17 dist-test-slave-6nmv krb5kdc[5881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 23:19:17 dist-test-slave-6nmv krb5kdc[5881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.129@KRBTEST.COM
I20260809 23:19:18.000877 6435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:17.994339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55578 (local address 127.1.235.129:33331)
0809 23:19:17.994499 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:17.994503 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:17.994521 (+ 18us) server_negotiation.cc:407] Connection header received
0809 23:19:17.994543 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:17.994545 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:17.994557 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:17.994633 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:17.995152 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:17.995785 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:17.996397 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:17.996656 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:17.996703 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:17.998578 (+ 1875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:17.998585 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:17.998586 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:17.998597 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:17.999984 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:18.000279 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:18.000281 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:18.000281 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:18.000334 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:18.000476 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:18.000477 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:18.000477 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:18.000580 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:18.000680 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:18.000743 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 23:19:18.000803 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":91,"threads_started":1}
Aug 09 23:19:17 dist-test-slave-6nmv krb5kdc[5881](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:18.007781 5970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:18.002134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60220 (local address 127.1.235.190:39209)
0809 23:19:18.002174 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:18.002176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:18.002260 (+ 84us) server_negotiation.cc:407] Connection header received
0809 23:19:18.002304 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:18.002305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:18.002312 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:18.002346 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:18.002750 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:18.003157 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:18.003710 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:18.003865 (+ 155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:18.003907 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:18.005662 (+ 1755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:18.005663 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:18.005663 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:18.005669 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:18.006781 (+ 1112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:18.007067 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:18.007068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:18.007068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:18.007110 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:18.007318 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:18.007318 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:18.007319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:18.007437 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:18.007499 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:18.007578 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 23:19:18.007670 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 23:19:18.008008 5928 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60220
I20260809 23:19:18.008265 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 5994
I20260809 23:19:18.018113 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 6141
I20260809 23:19:18.023061 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 6287
I20260809 23:19:18.030164 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 5894
2026-08-09T23:19:18Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1838 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:19:18 dist-test-slave-6nmv krb5kdc[6441](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:19:18 dist-test-slave-6nmv krb5kdc[6441](info): set up 2 sockets
Aug 09 23:19:18 dist-test-slave-6nmv krb5kdc[6441](info): commencing operation
krb5kdc: starting...
W20260809 23:19:19.069998 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:19:19 dist-test-slave-6nmv krb5kdc[6441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:19:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:19:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:19:19.184623 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:41993
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:45095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:41993
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:19.259096 6455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:19.259306 6455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:19.259346 6455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:19.260522 6455 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:19.260586 6455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:19.260609 6455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:19.260637 6455 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:19.260668 6455 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:19:19.262140 6455 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:45095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:41993
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:41993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:19.262396 6455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:19.262602 6455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:19.267311 6463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:19.267311 6465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:19.267331 6461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:19.267495 6455 server_base.cc:1034] running on GCE node
I20260809 23:19:19.267704 6455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:19.267959 6455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:19.269096 6455 hybrid_clock.cc:648] HybridClock initialized: now 1786317559269063 us; error 50 us; skew 500 ppm
Aug 09 23:19:19 dist-test-slave-6nmv krb5kdc[6441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317559, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:19.271585 6455 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:19:19.271986 6455 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:19.272063 6455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:19.272218 6455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:19.273244 6455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "006c4859c10f44a2a758f354c8799df1"
format_stamp: "Formatted at 2026-08-09 23:19:19 on dist-test-slave-6nmv"
server_key: "c3ec75b30e142f539405e1850de15efc"
server_key_iv: "dbf66a149e237f9bac4aa4927ef3da4e"
server_key_version: "encryptionkey@0"
I20260809 23:19:19.273597 6455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "006c4859c10f44a2a758f354c8799df1"
format_stamp: "Formatted at 2026-08-09 23:19:19 on dist-test-slave-6nmv"
server_key: "c3ec75b30e142f539405e1850de15efc"
server_key_iv: "dbf66a149e237f9bac4aa4927ef3da4e"
server_key_version: "encryptionkey@0"
I20260809 23:19:19.275009 6455 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:19:19.275797 6473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:19.275979 6455 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:19.276075 6455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "006c4859c10f44a2a758f354c8799df1"
format_stamp: "Formatted at 2026-08-09 23:19:19 on dist-test-slave-6nmv"
server_key: "c3ec75b30e142f539405e1850de15efc"
server_key_iv: "dbf66a149e237f9bac4aa4927ef3da4e"
server_key_version: "encryptionkey@0"
I20260809 23:19:19.276160 6455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:19.289964 6455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:19.292212 6455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:19.292371 6455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:19.296505 6455 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:41993
I20260809 23:19:19.296530 6526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:41993 every 8 connection(s)
I20260809 23:19:19.296793 6455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:19:19.297772 6527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:19.298787 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 6455
I20260809 23:19:19.298907 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:19:19.299094 1966 external_mini_cluster.cc:1428] Setting key e9c65f99243e0579be2fcbaf27cb74d6
I20260809 23:19:19.300591 6527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1: Bootstrap starting.
I20260809 23:19:19.301383 6527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:19.301689 6527 log.cc:824] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:19.302428 6527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1: No bootstrap required, opened a new log
I20260809 23:19:19.304147 6527 raft_consensus.cc:348] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "006c4859c10f44a2a758f354c8799df1" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41993 } }
I20260809 23:19:19.304299 6527 raft_consensus.cc:374] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:19.304347 6527 raft_consensus.cc:729] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 006c4859c10f44a2a758f354c8799df1, State: Initialized, Role: FOLLOWER
I20260809 23:19:19.304492 6527 consensus_queue.cc:260] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "006c4859c10f44a2a758f354c8799df1" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41993 } }
I20260809 23:19:19.304585 6527 raft_consensus.cc:388] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:19:19.304641 6527 raft_consensus.cc:482] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:19:19.304687 6527 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:19.305205 6527 raft_consensus.cc:504] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "006c4859c10f44a2a758f354c8799df1" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41993 } }
I20260809 23:19:19.305317 6527 leader_election.cc:302] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 006c4859c10f44a2a758f354c8799df1; no voters:
I20260809 23:19:19.305469 6527 leader_election.cc:288] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:19:19.305526 6532 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:19.305675 6532 raft_consensus.cc:686] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [term 1 LEADER]: Becoming Leader. State: Replica: 006c4859c10f44a2a758f354c8799df1, State: Running, Role: LEADER
I20260809 23:19:19.305713 6527 sys_catalog.cc:564] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:19.305784 6532 consensus_queue.cc:237] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "006c4859c10f44a2a758f354c8799df1" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41993 } }
Aug 09 23:19:19 dist-test-slave-6nmv krb5kdc[6441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:19.306094 6532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 006c4859c10f44a2a758f354c8799df1. Latest consensus state: current_term: 1 leader_uuid: "006c4859c10f44a2a758f354c8799df1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "006c4859c10f44a2a758f354c8799df1" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41993 } } }
I20260809 23:19:19.306180 6532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:19.306104 6534 sys_catalog.cc:455] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "006c4859c10f44a2a758f354c8799df1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "006c4859c10f44a2a758f354c8799df1" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41993 } } }
I20260809 23:19:19.306316 6534 sys_catalog.cc:458] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:19.306407 6538 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:19:19.306895 6538 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:19:19.308787 6538 catalog_manager.cc:1347] Generated new cluster ID: b478a853fe65402f9a84ba935de72e9b
I20260809 23:19:19.308844 6538 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:19:19.310964 6530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:19.299603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50286 (local address 127.1.235.190:41993)
0809 23:19:19.299774 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:19.299783 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:19.299815 (+ 32us) server_negotiation.cc:407] Connection header received
0809 23:19:19.300386 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:19.300392 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:19.300438 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:19.300558 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:19.301335 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.302550 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.303315 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.303707 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.303820 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:19.306490 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:19.306494 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:19.306494 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:19.306504 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:19.309427 (+ 2923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:19.309792 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:19.309795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:19.309796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:19.309921 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:19.310169 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:19.310170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:19.310171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:19.310397 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:19.310567 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:19.310660 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 23:19:19.310805 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":94,"threads_started":1}
I20260809 23:19:19.339306 6538 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:19:19.339901 6538 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:19:19.352802 6538 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1: Generated new TSK 0
I20260809 23:19:19.353003 6538 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:19:19.388669 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:41993
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:45095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:19.490067 6554 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:19.490252 6554 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:19.490274 6554 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:19.491387 6554 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:19.491428 6554 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:19.491482 6554 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:19:19.492954 6554 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:45095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:41993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6554
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:19.493193 6554 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:19.493418 6554 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:19.498013 6566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:19.498029 6563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:19.498123 6554 server_base.cc:1034] running on GCE node
W20260809 23:19:19.498054 6562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:19.498512 6554 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:19.498764 6554 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:19.499930 6554 hybrid_clock.cc:648] HybridClock initialized: now 1786317559499925 us; error 35 us; skew 500 ppm
Aug 09 23:19:19 dist-test-slave-6nmv krb5kdc[6441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317559, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:19.502429 6554 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:19:19.502704 6554 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:19.502744 6554 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:19.502825 6554 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:19.503813 6554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "1dc8298bfd024bec9a04f0593203839b"
format_stamp: "Formatted at 2026-08-09 23:19:19 on dist-test-slave-6nmv"
server_key: "12a239cdd42d133a30714a7dd66a01a8"
server_key_iv: "b0c429fd8efede247c553be0c97f53df"
server_key_version: "encryptionkey@0"
I20260809 23:19:19.504066 6554 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "1dc8298bfd024bec9a04f0593203839b"
format_stamp: "Formatted at 2026-08-09 23:19:19 on dist-test-slave-6nmv"
server_key: "12a239cdd42d133a30714a7dd66a01a8"
server_key_iv: "b0c429fd8efede247c553be0c97f53df"
server_key_version: "encryptionkey@0"
I20260809 23:19:19.505201 6554 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:19:19.505861 6573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:19.506146 6554 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 23:19:19.506297 6554 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "1dc8298bfd024bec9a04f0593203839b"
format_stamp: "Formatted at 2026-08-09 23:19:19 on dist-test-slave-6nmv"
server_key: "12a239cdd42d133a30714a7dd66a01a8"
server_key_iv: "b0c429fd8efede247c553be0c97f53df"
server_key_version: "encryptionkey@0"
I20260809 23:19:19.506377 6554 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:19.534665 6554 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:19.536284 6554 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:19.536425 6554 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:19.536636 6554 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:19.536924 6554 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:19.536975 6554 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:19.537006 6554 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:19.537029 6554 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:19.542475 6554 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:45923
I20260809 23:19:19.542512 6699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:45923 every 8 connection(s)
I20260809 23:19:19.542780 6554 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:19:19.544015 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 6554
I20260809 23:19:19.544134 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:19:19.544324 1966 external_mini_cluster.cc:1428] Setting key 388813e7fe0739101a5b6057fc402b82
Aug 09 23:19:19 dist-test-slave-6nmv krb5kdc[6441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317559, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:19.552762 6530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:19.543496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:38159 (local address 127.1.235.190:41993)
0809 23:19:19.543533 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:19.543535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:19.543741 (+ 206us) server_negotiation.cc:407] Connection header received
0809 23:19:19.544409 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:19.544410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:19.544423 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:19.544485 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:19.545619 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.546156 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.547455 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.547669 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.547759 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:19.549945 (+ 2186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:19.549946 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:19.549946 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:19.549952 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:19.551339 (+ 1387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:19.551793 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:19.551794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:19.551794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:19.551845 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:19.552144 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:19.552145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:19.552146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:19.552257 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:19.552309 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:19.552632 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 23:19:19.552700 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 23:19:19.552987 6704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:19.543485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:41993 (local address 127.1.235.129:38159)
0809 23:19:19.543631 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:19.543661 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:19.544294 (+ 633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:19.544628 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:19.544631 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:19.544845 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:19.545531 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:19.545538 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.546247 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.546248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:19.547367 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:19.547369 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.547771 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.547772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:19.547894 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:19.548353 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:19.548360 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:19.549861 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:19.551410 (+ 1549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:19.551417 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:19.551419 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:19.551719 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:19.551911 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:19.551912 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:19.551913 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:19.552055 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:19.552327 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:19.552334 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:19.552491 (+ 157us) client_negotiation.cc:769] Sending connection context
0809 23:19:19.552613 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 23:19:19.552778 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":88,"threads_started":1}
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
I20260809 23:19:19.553501 6700 heartbeater.cc:347] Connected to a master server at 127.1.235.190:41993
I20260809 23:19:19.553599 6700 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:19.553728 6700 heartbeater.cc:511] Master 127.1.235.190:41993 requested a full tablet report, sending...
I20260809 23:19:19.554280 6490 ts_manager.cc:194] Registered new tserver with Master: 1dc8298bfd024bec9a04f0593203839b (127.1.235.129:45923)
I20260809 23:19:19.554870 6490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:38159
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:19:19.568378 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:41993
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:45095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:19.642983 6707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:19.643199 6707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:19.643235 6707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:19.644320 6707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:19.644387 6707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:19.644430 6707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:19:19.645902 6707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:45095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:41993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:19.646155 6707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:19.646378 6707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:19.651417 6714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:19.651422 6715 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:19.651461 6707 server_base.cc:1034] running on GCE node
W20260809 23:19:19.651417 6717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:19.651901 6707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:19.652145 6707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:19.653280 6707 hybrid_clock.cc:648] HybridClock initialized: now 1786317559653264 us; error 33 us; skew 500 ppm
Aug 09 23:19:19 dist-test-slave-6nmv krb5kdc[6441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317559, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:19.655612 6707 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:19:19.655956 6707 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:19.656002 6707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:19.656159 6707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:19.657143 6707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "e3e1fa3d070d4c2d991527c136fc6431"
format_stamp: "Formatted at 2026-08-09 23:19:19 on dist-test-slave-6nmv"
server_key: "84b846aa8134fd35cb973972606c1bc0"
server_key_iv: "45f5d1f91576000361445b38e6251234"
server_key_version: "encryptionkey@0"
I20260809 23:19:19.657495 6707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "e3e1fa3d070d4c2d991527c136fc6431"
format_stamp: "Formatted at 2026-08-09 23:19:19 on dist-test-slave-6nmv"
server_key: "84b846aa8134fd35cb973972606c1bc0"
server_key_iv: "45f5d1f91576000361445b38e6251234"
server_key_version: "encryptionkey@0"
I20260809 23:19:19.658748 6707 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:19:19.659430 6725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:19.659636 6707 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:19:19.659703 6707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "e3e1fa3d070d4c2d991527c136fc6431"
format_stamp: "Formatted at 2026-08-09 23:19:19 on dist-test-slave-6nmv"
server_key: "84b846aa8134fd35cb973972606c1bc0"
server_key_iv: "45f5d1f91576000361445b38e6251234"
server_key_version: "encryptionkey@0"
I20260809 23:19:19.659792 6707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:19.678354 6707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:19.680409 6707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:19.680562 6707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:19.680787 6707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:19.681099 6707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:19.681154 6707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:19.681206 6707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:19.681233 6707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:19.686933 6707 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:38171
I20260809 23:19:19.686975 6851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:38171 every 8 connection(s)
I20260809 23:19:19.687229 6707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:19:19.692632 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 6707
I20260809 23:19:19.692766 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:19:19.692966 1966 external_mini_cluster.cc:1428] Setting key ae926c80ab1ed71fe1bd13584a4631ea
Aug 09 23:19:19 dist-test-slave-6nmv krb5kdc[6441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317559, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:19.696491 6530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:19.687927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:55909 (local address 127.1.235.190:41993)
0809 23:19:19.688015 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:19.688017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:19.688169 (+ 152us) server_negotiation.cc:407] Connection header received
0809 23:19:19.688610 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:19.688611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:19.688622 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:19.688672 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:19.689498 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.690109 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.691023 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.691220 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.691275 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:19.693561 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:19.693562 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:19.693563 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:19.693571 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:19.695041 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:19.695520 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:19.695521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:19.695522 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:19.695584 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:19.695853 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:19.695854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:19.695855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:19.695968 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:19.696046 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:19.696322 (+ 276us) server_negotiation.cc:299] Negotiation successful
0809 23:19:19.696405 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 23:19:19.696669 6854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:19.687880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:41993 (local address 127.1.235.130:55909)
0809 23:19:19.688046 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:19.688080 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:19.688522 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:19.688721 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:19.688724 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:19.688971 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:19.689426 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:19.689431 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.690184 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.690185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:19.690938 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:19.690940 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.691293 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.691293 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:19.691382 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:19.691804 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:19.691811 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:19.693454 (+ 1643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:19.695123 (+ 1669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:19.695130 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:19.695133 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:19.695450 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:19.695666 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:19.695667 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:19.695667 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:19.695777 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:19.696037 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:19.696044 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:19.696181 (+ 137us) client_negotiation.cc:769] Sending connection context
0809 23:19:19.696284 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 23:19:19.696436 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":99,"threads_started":1}
I20260809 23:19:19.697077 6852 heartbeater.cc:347] Connected to a master server at 127.1.235.190:41993
I20260809 23:19:19.697170 6852 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:19.697324 6852 heartbeater.cc:511] Master 127.1.235.190:41993 requested a full tablet report, sending...
I20260809 23:19:19.697680 6490 ts_manager.cc:194] Registered new tserver with Master: e3e1fa3d070d4c2d991527c136fc6431 (127.1.235.130:38171)
I20260809 23:19:19.698114 6490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:55909
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:19:19.718098 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:41993
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:45095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:19.796023 6857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:19.796185 6857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:19.796205 6857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:19.797173 6857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:19.797204 6857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:19.797226 6857 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:19:19.798516 6857 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:45095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:41993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6857
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:19.798676 6857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:19.798821 6857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:19.803438 6862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:19.803448 6866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:19.803498 6864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:19.803685 6857 server_base.cc:1034] running on GCE node
I20260809 23:19:19.803848 6857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:19.804018 6857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:19.805183 6857 hybrid_clock.cc:648] HybridClock initialized: now 1786317559805171 us; error 24 us; skew 500 ppm
Aug 09 23:19:19 dist-test-slave-6nmv krb5kdc[6441](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317559, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:19.807897 6857 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:19:19.808233 6857 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:19.808277 6857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:19.808424 6857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:19.809491 6857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "46d0239603624e389e927f1cb2471443"
format_stamp: "Formatted at 2026-08-09 23:19:19 on dist-test-slave-6nmv"
server_key: "84c4aa41937b31d6fe8b9dd03c674d52"
server_key_iv: "d60fe0912f24f6ae0e1c4e530f0fc829"
server_key_version: "encryptionkey@0"
I20260809 23:19:19.809880 6857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "46d0239603624e389e927f1cb2471443"
format_stamp: "Formatted at 2026-08-09 23:19:19 on dist-test-slave-6nmv"
server_key: "84c4aa41937b31d6fe8b9dd03c674d52"
server_key_iv: "d60fe0912f24f6ae0e1c4e530f0fc829"
server_key_version: "encryptionkey@0"
I20260809 23:19:19.811295 6857 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:19.812058 6874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:19.812259 6857 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:19.812379 6857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "46d0239603624e389e927f1cb2471443"
format_stamp: "Formatted at 2026-08-09 23:19:19 on dist-test-slave-6nmv"
server_key: "84c4aa41937b31d6fe8b9dd03c674d52"
server_key_iv: "d60fe0912f24f6ae0e1c4e530f0fc829"
server_key_version: "encryptionkey@0"
I20260809 23:19:19.812448 6857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:19.838637 6857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:19.840694 6857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:19.840862 6857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:19.841123 6857 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:19.841461 6857 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:19.841523 6857 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:19.841562 6857 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:19.841588 6857 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:19.847162 6857 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:45949
I20260809 23:19:19.847208 7001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:45949 every 8 connection(s)
I20260809 23:19:19.847602 6857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:19:19.852527 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 6857
I20260809 23:19:19.852645 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:19:19.852864 1966 external_mini_cluster.cc:1428] Setting key aeee806bb9511bfcd4a1b7fa164d6778
Aug 09 23:19:19 dist-test-slave-6nmv krb5kdc[6441](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317559, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:19.856729 6530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:19.848279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:41133 (local address 127.1.235.190:41993)
0809 23:19:19.848340 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:19.848342 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:19.848530 (+ 188us) server_negotiation.cc:407] Connection header received
0809 23:19:19.849044 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:19.849045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:19.849054 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:19.849109 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:19.850131 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.850619 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.851549 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.851757 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.851808 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:19.854306 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:19.854307 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:19.854307 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:19.854313 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:19.855675 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:19.855990 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:19.855991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:19.855992 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:19.856046 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:19.856243 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:19.856244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:19.856244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:19.856357 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:19.856404 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:19.856614 (+ 210us) server_negotiation.cc:299] Negotiation successful
0809 23:19:19.856669 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 23:19:19.856981 7005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:19.848232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:41993 (local address 127.1.235.131:41133)
0809 23:19:19.848382 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:19.848440 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:19.848933 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:19.849195 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:19.849199 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:19.849443 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:19.850035 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:19.850041 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.850690 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.850691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:19.851480 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:19.851482 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.851828 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.851829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:19.851926 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:19.852374 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:19.852384 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:19.854223 (+ 1839us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:19.855739 (+ 1516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:19.855743 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:19.855745 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:19.855932 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:19.856102 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:19.856103 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:19.856103 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:19.856192 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:19.856409 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:19.856413 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:19.856518 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 23:19:19.856604 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 23:19:19.856718 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":81,"threads_started":1}
I20260809 23:19:19.857412 7002 heartbeater.cc:347] Connected to a master server at 127.1.235.190:41993
I20260809 23:19:19.857498 7002 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:19.857683 7002 heartbeater.cc:511] Master 127.1.235.190:41993 requested a full tablet report, sending...
I20260809 23:19:19.858081 6490 ts_manager.cc:194] Registered new tserver with Master: 46d0239603624e389e927f1cb2471443 (127.1.235.131:45949)
I20260809 23:19:19.858438 6490 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:41133
I20260809 23:19:19.864696 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:19:19.871524 6530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:19.865936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50302 (local address 127.1.235.190:41993)
0809 23:19:19.866007 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:19.866009 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:19.866114 (+ 105us) server_negotiation.cc:407] Connection header received
0809 23:19:19.866176 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:19.866177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:19.866186 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:19.866236 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:19.866747 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.867182 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.867840 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.868017 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.868086 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:19.869059 (+ 973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:19.869061 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:19.869061 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:19.869068 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:19.870283 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:19.870669 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:19.870670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:19.870670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:19.870736 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:19.870956 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:19.870957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:19.870957 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:19.871111 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:19.871241 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:19.871350 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 23:19:19.871431 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 23:19:19.872989 6490 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50302:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:19:19.874571 6490 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:19:19.880986 7021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:19.877132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50980 (local address 127.1.235.131:45949)
0809 23:19:19.877691 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:19.877695 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:19.877703 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:19:19.877733 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:19.877735 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:19.877749 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:19.877844 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:19.877914 (+ 70us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.878842 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.880078 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.880553 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.880645 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:19.880700 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:19.880870 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 23:19:19.880909 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":85,"threads_started":1}
I20260809 23:19:19.880990 7014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:19.877049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:45949 (local address 127.0.0.1:50980)
0809 23:19:19.877255 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:19.877267 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:19.877322 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:19.877829 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:19.877830 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:19.877832 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:19.877871 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:19.877872 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.878965 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.878966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:19.879974 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:19.879976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.880658 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.880659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:19.880740 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:19.880753 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 23:19:19.880851 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 23:19:19.880905 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":3,"thread_start_us":70,"threads_started":1}
I20260809 23:19:19.881095 7017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:19.876983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41334 (local address 127.1.235.129:45923)
0809 23:19:19.877204 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:19.877209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:19.877328 (+ 119us) server_negotiation.cc:407] Connection header received
0809 23:19:19.877376 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:19.877378 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:19.877390 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:19.877534 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:19.877616 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.878390 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.879820 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.880550 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.880623 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:19.880681 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:19.880951 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 23:19:19.880993 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":83,"threads_started":1}
I20260809 23:19:19.881242 7019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:19.876835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:45923 (local address 127.0.0.1:41334)
0809 23:19:19.877183 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:19.877191 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:19.877244 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:19.877469 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:19.877472 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:19.877473 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:19.877533 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:19.877535 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.878465 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.878466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:19.879708 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:19.879711 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.880714 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.880715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:19.880776 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:19.880780 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:19:19.880827 (+ 47us) client_negotiation.cc:240] Negotiation successful
0809 23:19:19.880887 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":77,"threads_started":1}
I20260809 23:19:19.881667 6930 tablet_service.cc:1467] Processing CreateTablet for tablet 973b70c1b1ae44c394bc6729e86c86e0 (DEFAULT_TABLE table=test-table [id=bab5a656a8164d0194ba9ee5f0572901]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:19.882107 7015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:19.876803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:38171 (local address 127.0.0.1:42724)
0809 23:19:19.877133 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:19.877185 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:19.877244 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:19.877488 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:19.877488 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:19.877491 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:19.877547 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:19.877549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.879401 (+ 1852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.879402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:19.880551 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:19.880555 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.881890 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.881891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:19.881951 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:19.881954 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:19:19.882004 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 23:19:19.882041 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":91,"threads_started":1}
I20260809 23:19:19.882270 6930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 973b70c1b1ae44c394bc6729e86c86e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:19.882376 7016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:19.876942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42724 (local address 127.1.235.130:38171)
0809 23:19:19.877325 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:19.877329 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:19.877338 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:19:19.877379 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:19.877381 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:19.877395 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:19.877473 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:19.878509 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.879280 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.880649 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:19.881711 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:19.881777 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:19.881839 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:19.882259 (+ 420us) server_negotiation.cc:299] Negotiation successful
0809 23:19:19.882300 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":86,"threads_started":1}
I20260809 23:19:19.882411 6628 tablet_service.cc:1467] Processing CreateTablet for tablet 973b70c1b1ae44c394bc6729e86c86e0 (DEFAULT_TABLE table=test-table [id=bab5a656a8164d0194ba9ee5f0572901]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:19.882750 6628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 973b70c1b1ae44c394bc6729e86c86e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:19.882939 6780 tablet_service.cc:1467] Processing CreateTablet for tablet 973b70c1b1ae44c394bc6729e86c86e0 (DEFAULT_TABLE table=test-table [id=bab5a656a8164d0194ba9ee5f0572901]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:19.883234 6780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 973b70c1b1ae44c394bc6729e86c86e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:19.885057 7022 tablet_bootstrap.cc:492] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443: Bootstrap starting.
I20260809 23:19:19.885689 7022 tablet_bootstrap.cc:654] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:19.886127 7023 tablet_bootstrap.cc:492] T 973b70c1b1ae44c394bc6729e86c86e0 P 1dc8298bfd024bec9a04f0593203839b: Bootstrap starting.
I20260809 23:19:19.886487 7025 tablet_bootstrap.cc:492] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431: Bootstrap starting.
I20260809 23:19:19.886500 7022 log.cc:824] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:19.886912 7023 tablet_bootstrap.cc:654] T 973b70c1b1ae44c394bc6729e86c86e0 P 1dc8298bfd024bec9a04f0593203839b: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:19.887110 7025 tablet_bootstrap.cc:654] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:19.887295 7022 tablet_bootstrap.cc:492] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443: No bootstrap required, opened a new log
I20260809 23:19:19.887358 7022 ts_tablet_manager.cc:1397] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 23:19:19.887503 7023 log.cc:824] T 973b70c1b1ae44c394bc6729e86c86e0 P 1dc8298bfd024bec9a04f0593203839b: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:19.887692 7025 log.cc:824] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:19.888257 7023 tablet_bootstrap.cc:492] T 973b70c1b1ae44c394bc6729e86c86e0 P 1dc8298bfd024bec9a04f0593203839b: No bootstrap required, opened a new log
I20260809 23:19:19.888324 7023 ts_tablet_manager.cc:1397] T 973b70c1b1ae44c394bc6729e86c86e0 P 1dc8298bfd024bec9a04f0593203839b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:19:19.888387 7025 tablet_bootstrap.cc:492] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431: No bootstrap required, opened a new log
I20260809 23:19:19.888449 7025 ts_tablet_manager.cc:1397] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:19:19.889281 7022 raft_consensus.cc:348] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3e1fa3d070d4c2d991527c136fc6431" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38171 } } peers { permanent_uuid: "1dc8298bfd024bec9a04f0593203839b" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45923 } } peers { permanent_uuid: "46d0239603624e389e927f1cb2471443" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 45949 } }
I20260809 23:19:19.889433 7022 raft_consensus.cc:374] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:19.889467 7022 raft_consensus.cc:729] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46d0239603624e389e927f1cb2471443, State: Initialized, Role: FOLLOWER
I20260809 23:19:19.889582 7022 consensus_queue.cc:260] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3e1fa3d070d4c2d991527c136fc6431" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38171 } } peers { permanent_uuid: "1dc8298bfd024bec9a04f0593203839b" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45923 } } peers { permanent_uuid: "46d0239603624e389e927f1cb2471443" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 45949 } }
I20260809 23:19:19.889864 7022 ts_tablet_manager.cc:1428] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 23:19:19.889889 7002 heartbeater.cc:503] Master 127.1.235.190:41993 was elected leader, sending a full tablet report...
I20260809 23:19:19.889847 7025 raft_consensus.cc:348] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3e1fa3d070d4c2d991527c136fc6431" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38171 } } peers { permanent_uuid: "1dc8298bfd024bec9a04f0593203839b" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45923 } } peers { permanent_uuid: "46d0239603624e389e927f1cb2471443" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 45949 } }
I20260809 23:19:19.889983 7025 raft_consensus.cc:374] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:19.890029 7025 raft_consensus.cc:729] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3e1fa3d070d4c2d991527c136fc6431, State: Initialized, Role: FOLLOWER
I20260809 23:19:19.890152 7025 consensus_queue.cc:260] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3e1fa3d070d4c2d991527c136fc6431" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38171 } } peers { permanent_uuid: "1dc8298bfd024bec9a04f0593203839b" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45923 } } peers { permanent_uuid: "46d0239603624e389e927f1cb2471443" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 45949 } }
I20260809 23:19:19.890228 7023 raft_consensus.cc:348] T 973b70c1b1ae44c394bc6729e86c86e0 P 1dc8298bfd024bec9a04f0593203839b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3e1fa3d070d4c2d991527c136fc6431" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38171 } } peers { permanent_uuid: "1dc8298bfd024bec9a04f0593203839b" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45923 } } peers { permanent_uuid: "46d0239603624e389e927f1cb2471443" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 45949 } }
I20260809 23:19:19.890379 7023 raft_consensus.cc:374] T 973b70c1b1ae44c394bc6729e86c86e0 P 1dc8298bfd024bec9a04f0593203839b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:19.890425 7023 raft_consensus.cc:729] T 973b70c1b1ae44c394bc6729e86c86e0 P 1dc8298bfd024bec9a04f0593203839b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc8298bfd024bec9a04f0593203839b, State: Initialized, Role: FOLLOWER
I20260809 23:19:19.890450 7025 ts_tablet_manager.cc:1428] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:19:19.890528 7023 consensus_queue.cc:260] T 973b70c1b1ae44c394bc6729e86c86e0 P 1dc8298bfd024bec9a04f0593203839b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3e1fa3d070d4c2d991527c136fc6431" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38171 } } peers { permanent_uuid: "1dc8298bfd024bec9a04f0593203839b" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45923 } } peers { permanent_uuid: "46d0239603624e389e927f1cb2471443" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 45949 } }
I20260809 23:19:19.890581 6852 heartbeater.cc:503] Master 127.1.235.190:41993 was elected leader, sending a full tablet report...
I20260809 23:19:19.890818 7023 ts_tablet_manager.cc:1428] T 973b70c1b1ae44c394bc6729e86c86e0 P 1dc8298bfd024bec9a04f0593203839b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 23:19:19.890851 6700 heartbeater.cc:503] Master 127.1.235.190:41993 was elected leader, sending a full tablet report...
W20260809 23:19:19.937801 6853 tablet.cc:2369] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:19:20.008713 7029 raft_consensus.cc:482] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:19:20.008857 7029 raft_consensus.cc:504] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3e1fa3d070d4c2d991527c136fc6431" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38171 } } peers { permanent_uuid: "1dc8298bfd024bec9a04f0593203839b" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45923 } } peers { permanent_uuid: "46d0239603624e389e927f1cb2471443" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 45949 } }
I20260809 23:19:20.009289 7029 leader_election.cc:288] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3e1fa3d070d4c2d991527c136fc6431 (127.1.235.130:38171), 1dc8298bfd024bec9a04f0593203839b (127.1.235.129:45923)
I20260809 23:19:20.013411 7016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.009673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:53541 (local address 127.1.235.130:38171)
0809 23:19:20.009717 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:20.009719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:20.009728 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:19:20.009758 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:20.009759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:20.009768 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:20.009907 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:20.010123 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:20.010889 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:20.012462 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:20.013052 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:20.013131 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:20.013139 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:20.013299 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 23:19:20.013341 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 23:19:20.013411 7017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.009663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:49141 (local address 127.1.235.129:45923)
0809 23:19:20.009714 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:20.009716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:20.009871 (+ 155us) server_negotiation.cc:407] Connection header received
0809 23:19:20.009960 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:20.009961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:20.009979 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:20.010019 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:20.010170 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:20.010888 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:20.012462 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:20.013046 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:20.013131 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:20.013139 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:20.013299 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 23:19:20.013341 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 23:19:20.013420 7005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.009551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:38171 (local address 127.1.235.131:53541)
0809 23:19:20.009615 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:20.009628 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:20.009675 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:20.009921 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:20.009922 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:20.009925 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:20.010017 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:20.010019 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:20.010975 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:20.010976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:20.012332 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:20.012335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:20.013138 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:20.013139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:20.013220 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:20.013221 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 23:19:20.013279 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 23:19:20.013325 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":96}
I20260809 23:19:20.013427 7032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.009567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:45923 (local address 127.1.235.131:49141)
0809 23:19:20.009763 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:20.009774 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:20.009895 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:20.010040 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:20.010041 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:20.010043 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:20.010101 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:20.010102 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:20.010976 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:20.010976 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:20.012332 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:20.012335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:20.013138 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:20.013139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:20.013216 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:20.013221 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 23:19:20.013279 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 23:19:20.013325 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":60,"thread_start_us":122,"threads_started":1}
I20260809 23:19:20.013904 6803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "973b70c1b1ae44c394bc6729e86c86e0" candidate_uuid: "46d0239603624e389e927f1cb2471443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3e1fa3d070d4c2d991527c136fc6431" is_pre_election: true
I20260809 23:19:20.014087 6803 raft_consensus.cc:2454] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46d0239603624e389e927f1cb2471443 in term 0.
I20260809 23:19:20.014103 6652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "973b70c1b1ae44c394bc6729e86c86e0" candidate_uuid: "46d0239603624e389e927f1cb2471443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8298bfd024bec9a04f0593203839b" is_pre_election: true
I20260809 23:19:20.014276 6652 raft_consensus.cc:2454] T 973b70c1b1ae44c394bc6729e86c86e0 P 1dc8298bfd024bec9a04f0593203839b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46d0239603624e389e927f1cb2471443 in term 0.
I20260809 23:19:20.014367 6877 leader_election.cc:302] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46d0239603624e389e927f1cb2471443, e3e1fa3d070d4c2d991527c136fc6431; no voters:
I20260809 23:19:20.014514 7029 raft_consensus.cc:2781] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:19:20.014580 7029 raft_consensus.cc:482] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:19:20.014597 7029 raft_consensus.cc:3037] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:20.015349 7029 raft_consensus.cc:504] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3e1fa3d070d4c2d991527c136fc6431" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38171 } } peers { permanent_uuid: "1dc8298bfd024bec9a04f0593203839b" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45923 } } peers { permanent_uuid: "46d0239603624e389e927f1cb2471443" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 45949 } }
I20260809 23:19:20.015501 7029 leader_election.cc:288] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [CANDIDATE]: Term 1 election: Requested vote from peers e3e1fa3d070d4c2d991527c136fc6431 (127.1.235.130:38171), 1dc8298bfd024bec9a04f0593203839b (127.1.235.129:45923)
I20260809 23:19:20.015658 6652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "973b70c1b1ae44c394bc6729e86c86e0" candidate_uuid: "46d0239603624e389e927f1cb2471443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1dc8298bfd024bec9a04f0593203839b"
I20260809 23:19:20.015651 6803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "973b70c1b1ae44c394bc6729e86c86e0" candidate_uuid: "46d0239603624e389e927f1cb2471443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3e1fa3d070d4c2d991527c136fc6431"
I20260809 23:19:20.015720 6652 raft_consensus.cc:3037] T 973b70c1b1ae44c394bc6729e86c86e0 P 1dc8298bfd024bec9a04f0593203839b [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:20.015740 6803 raft_consensus.cc:3037] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:20.016431 6652 raft_consensus.cc:2454] T 973b70c1b1ae44c394bc6729e86c86e0 P 1dc8298bfd024bec9a04f0593203839b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d0239603624e389e927f1cb2471443 in term 1.
I20260809 23:19:20.016577 6803 raft_consensus.cc:2454] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46d0239603624e389e927f1cb2471443 in term 1.
I20260809 23:19:20.016613 6875 leader_election.cc:302] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1dc8298bfd024bec9a04f0593203839b, 46d0239603624e389e927f1cb2471443; no voters:
I20260809 23:19:20.016741 7029 raft_consensus.cc:2781] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:20.016880 7029 raft_consensus.cc:686] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [term 1 LEADER]: Becoming Leader. State: Replica: 46d0239603624e389e927f1cb2471443, State: Running, Role: LEADER
I20260809 23:19:20.016975 7029 consensus_queue.cc:237] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3e1fa3d070d4c2d991527c136fc6431" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38171 } } peers { permanent_uuid: "1dc8298bfd024bec9a04f0593203839b" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45923 } } peers { permanent_uuid: "46d0239603624e389e927f1cb2471443" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 45949 } }
I20260809 23:19:20.017884 6489 catalog_manager.cc:5495] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 reported cstate change: term changed from 0 to 1, leader changed from <none> to 46d0239603624e389e927f1cb2471443 (127.1.235.131). New cstate: current_term: 1 leader_uuid: "46d0239603624e389e927f1cb2471443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3e1fa3d070d4c2d991527c136fc6431" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1dc8298bfd024bec9a04f0593203839b" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46d0239603624e389e927f1cb2471443" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 45949 } health_report { overall_health: HEALTHY } } }
I20260809 23:19:20.030222 7021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.027790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50986 (local address 127.1.235.131:45949)
0809 23:19:20.027849 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:20.027852 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:20.027860 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:19:20.027920 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:20.027921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:20.027947 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:20.028026 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:19:20.028174 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:20.028641 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:20.029397 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:20.029595 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:20.029672 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:20.029857 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:19:20.029961 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:19:20.030060 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:20.030086 (+ 26us) server_negotiation.cc:299] Negotiation successful
0809 23:19:20.030115 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 23:19:20.032125 6652 raft_consensus.cc:1261] T 973b70c1b1ae44c394bc6729e86c86e0 P 1dc8298bfd024bec9a04f0593203839b [term 1 FOLLOWER]: Refusing update from remote peer 46d0239603624e389e927f1cb2471443: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:20.032133 6803 raft_consensus.cc:1261] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431 [term 1 FOLLOWER]: Refusing update from remote peer 46d0239603624e389e927f1cb2471443: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:20.032529 7029 consensus_queue.cc:1035] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1dc8298bfd024bec9a04f0593203839b" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 45923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:20.032698 7033 consensus_queue.cc:1035] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3e1fa3d070d4c2d991527c136fc6431" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:20.035018 7037 mvcc.cc:205] Tried to move back new op lower bound from 7316756725888401408 to 7316756725830287360. Current Snapshot: MvccSnapshot[applied={T|T < 7316756725888401408}]
I20260809 23:19:20.037546 6489 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:20.037654 6489 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50302:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:20.038517 6489 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 006c4859c10f44a2a758f354c8799df1: Sending DeleteTablet for 3 replicas of tablet 973b70c1b1ae44c394bc6729e86c86e0
I20260809 23:19:20.038857 6780 tablet_service.cc:1514] Processing DeleteTablet for tablet 973b70c1b1ae44c394bc6729e86c86e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:20 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:42724
I20260809 23:19:20.038898 6628 tablet_service.cc:1514] Processing DeleteTablet for tablet 973b70c1b1ae44c394bc6729e86c86e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:20 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:41334
I20260809 23:19:20.039093 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 6554
I20260809 23:19:20.042425 6930 tablet_service.cc:1514] Processing DeleteTablet for tablet 973b70c1b1ae44c394bc6729e86c86e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:20 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:50980
I20260809 23:19:20.042459 7052 tablet_replica.cc:330] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431: stopping tablet replica
I20260809 23:19:20.042563 7052 raft_consensus.cc:2229] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:20.042672 7052 raft_consensus.cc:2258] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:20.043206 7052 ts_tablet_manager.cc:1905] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:20.044685 7052 ts_tablet_manager.cc:1918] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:19:20.044771 7052 log.cc:1196] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/973b70c1b1ae44c394bc6729e86c86e0
I20260809 23:19:20.045037 7052 ts_tablet_manager.cc:1939] T 973b70c1b1ae44c394bc6729e86c86e0 P e3e1fa3d070d4c2d991527c136fc6431: Deleting consensus metadata
I20260809 23:19:20.045527 6476 catalog_manager.cc:4841] TS e3e1fa3d070d4c2d991527c136fc6431 (127.1.235.130:38171): tablet 973b70c1b1ae44c394bc6729e86c86e0 (table test-table [id=bab5a656a8164d0194ba9ee5f0572901]) successfully deleted
I20260809 23:19:20.050254 7054 tablet_replica.cc:330] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443: stopping tablet replica
I20260809 23:19:20.050371 7054 raft_consensus.cc:2229] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:19:20.050504 7054 raft_consensus.cc:2258] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:20.050985 7054 ts_tablet_manager.cc:1905] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 23:19:20.051688 6474 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.235.129:45923 (error 108)
I20260809 23:19:20.051929 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 6707
I20260809 23:19:20.052898 7015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.052086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:45923 (local address 127.0.0.1:41348)
0809 23:19:20.052821 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:20.052864 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.129:45923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":712}
W20260809 23:19:20.053023 6474 catalog_manager.cc:4584] TS 1dc8298bfd024bec9a04f0593203839b (127.1.235.129:45923): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 973b70c1b1ae44c394bc6729e86c86e0: Network error: Client connection negotiation failed: client connection to 127.1.235.129:45923: connect: Connection refused (error 111)
I20260809 23:19:20.054358 7054 ts_tablet_manager.cc:1918] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:19:20.054423 7054 log.cc:1196] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/973b70c1b1ae44c394bc6729e86c86e0
I20260809 23:19:20.054701 7054 ts_tablet_manager.cc:1939] T 973b70c1b1ae44c394bc6729e86c86e0 P 46d0239603624e389e927f1cb2471443: Deleting consensus metadata
I20260809 23:19:20.055691 6474 catalog_manager.cc:4841] TS 46d0239603624e389e927f1cb2471443 (127.1.235.131:45949): tablet 973b70c1b1ae44c394bc6729e86c86e0 (table test-table [id=bab5a656a8164d0194ba9ee5f0572901]) successfully deleted
I20260809 23:19:20.058255 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 6857
I20260809 23:19:20.064390 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 6455
2026-08-09T23:19:20Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2033 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T23:19:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:19:20Z Disabled control of system clock
I20260809 23:19:20.092794 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:41811
--webserver_interface=127.1.235.190
--webserver_port=0
--builtin_ntp_servers=127.1.235.148:41603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:41811
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 23:19:20.172209 7060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:20.172394 7060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:20.172416 7060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:20.173437 7060 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:20.173468 7060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:20.173480 7060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:20.173492 7060 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:20.173504 7060 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:19:20.174800 7060 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:41603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:41811
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:41811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:20.174979 7060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:20.175199 7060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:20.179287 7066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:20.179297 7065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:20.179524 7060 server_base.cc:1034] running on GCE node
W20260809 23:19:20.179304 7068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:20.179838 7060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:20.180160 7060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:20.181348 7060 hybrid_clock.cc:648] HybridClock initialized: now 1786317560181327 us; error 32 us; skew 500 ppm
I20260809 23:19:20.182654 7060 webserver.cc:460] Webserver started at http://127.1.235.190:43441/ using document root <none> and password file <none>
I20260809 23:19:20.182895 7060 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:20.182978 7060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:20.183135 7060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:20.184091 7060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "a087e4f0cd3444e798d257246c58af38"
format_stamp: "Formatted at 2026-08-09 23:19:20 on dist-test-slave-6nmv"
server_key: "7f1f9de46afa3780c476e95126854c79"
server_key_iv: "020f79105aba19568816a8a777097e96"
server_key_version: "encryptionkey@0"
I20260809 23:19:20.184473 7060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "a087e4f0cd3444e798d257246c58af38"
format_stamp: "Formatted at 2026-08-09 23:19:20 on dist-test-slave-6nmv"
server_key: "7f1f9de46afa3780c476e95126854c79"
server_key_iv: "020f79105aba19568816a8a777097e96"
server_key_version: "encryptionkey@0"
I20260809 23:19:20.185711 7060 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:19:20.186463 7074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:20.186651 7060 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:19:20.186764 7060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "a087e4f0cd3444e798d257246c58af38"
format_stamp: "Formatted at 2026-08-09 23:19:20 on dist-test-slave-6nmv"
server_key: "7f1f9de46afa3780c476e95126854c79"
server_key_iv: "020f79105aba19568816a8a777097e96"
server_key_version: "encryptionkey@0"
I20260809 23:19:20.186832 7060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:20.190052 7060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:20.190302 7060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:20.190439 7060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:20.194271 7060 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:41811
I20260809 23:19:20.194301 7132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:41811 every 8 connection(s)
I20260809 23:19:20.194623 7060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:19:20.195261 7134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:20.196729 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 7060
I20260809 23:19:20.196837 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:19:20.197037 1966 external_mini_cluster.cc:1428] Setting key 5535b7ce40d01daaee5cc37b0caf6653
I20260809 23:19:20.198239 7134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38: Bootstrap starting.
I20260809 23:19:20.198946 7134 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:20.199304 7134 log.cc:824] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:20.199445 7139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.197525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39272 (local address 127.1.235.190:41811)
0809 23:19:20.197692 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:20.197699 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:20.197738 (+ 39us) server_negotiation.cc:407] Connection header received
0809 23:19:20.198153 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:20.198160 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:20.198195 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:20.198302 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:20.198966 (+ 664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:20.198969 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:20.198969 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:19:20.198972 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:20.199035 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:19:20.199049 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:20.199152 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:20.199229 (+ 77us) server_negotiation.cc:299] Negotiation successful
0809 23:19:20.199279 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":77,"threads_started":1}
I20260809 23:19:20.199950 7134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38: No bootstrap required, opened a new log
I20260809 23:19:20.201297 7134 raft_consensus.cc:348] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a087e4f0cd3444e798d257246c58af38" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41811 } }
I20260809 23:19:20.201442 7134 raft_consensus.cc:374] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:20.201488 7134 raft_consensus.cc:729] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a087e4f0cd3444e798d257246c58af38, State: Initialized, Role: FOLLOWER
I20260809 23:19:20.201594 7134 consensus_queue.cc:260] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a087e4f0cd3444e798d257246c58af38" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41811 } }
I20260809 23:19:20.201676 7134 raft_consensus.cc:388] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:19:20.201716 7134 raft_consensus.cc:482] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:19:20.201759 7134 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:20.202538 7134 raft_consensus.cc:504] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a087e4f0cd3444e798d257246c58af38" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41811 } }
I20260809 23:19:20.202651 7134 leader_election.cc:302] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a087e4f0cd3444e798d257246c58af38; no voters:
I20260809 23:19:20.202800 7134 leader_election.cc:288] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:19:20.202848 7142 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:20.202984 7142 raft_consensus.cc:686] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [term 1 LEADER]: Becoming Leader. State: Replica: a087e4f0cd3444e798d257246c58af38, State: Running, Role: LEADER
I20260809 23:19:20.203073 7142 consensus_queue.cc:237] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a087e4f0cd3444e798d257246c58af38" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41811 } }
I20260809 23:19:20.203100 7134 sys_catalog.cc:564] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:20.203364 7143 sys_catalog.cc:455] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a087e4f0cd3444e798d257246c58af38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a087e4f0cd3444e798d257246c58af38" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41811 } } }
I20260809 23:19:20.203506 7143 sys_catalog.cc:458] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:20.203361 7144 sys_catalog.cc:455] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a087e4f0cd3444e798d257246c58af38. Latest consensus state: current_term: 1 leader_uuid: "a087e4f0cd3444e798d257246c58af38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a087e4f0cd3444e798d257246c58af38" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41811 } } }
I20260809 23:19:20.203699 7149 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:19:20.203707 7144 sys_catalog.cc:458] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:20.204186 7149 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:19:20.205739 7149 catalog_manager.cc:1347] Generated new cluster ID: 5846485e12cb4523b77078a7bf9536a0
I20260809 23:19:20.205788 7149 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:19:20.221629 7149 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:19:20.221774 7149 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:19:20.227452 7149 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38: Generated new TSK 0
I20260809 23:19:20.227605 7149 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:19:20.232486 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:41811
--builtin_ntp_servers=127.1.235.148:41603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 23:19:20.327967 7164 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:20.328171 7164 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:20.328195 7164 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:20.329350 7164 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:20.329396 7164 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:20.329422 7164 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:19:20.330838 7164 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:41603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:41811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7164
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:20.331107 7164 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:20.331457 7164 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:20.337659 7174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:20.337703 7175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:20.337729 7177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:20.338256 7164 server_base.cc:1034] running on GCE node
I20260809 23:19:20.338486 7164 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:20.338727 7164 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:20.339887 7164 hybrid_clock.cc:648] HybridClock initialized: now 1786317560339877 us; error 32 us; skew 500 ppm
I20260809 23:19:20.341132 7164 webserver.cc:460] Webserver started at http://127.1.235.129:34753/ using document root <none> and password file <none>
I20260809 23:19:20.341398 7164 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:20.341460 7164 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:20.341614 7164 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:20.342686 7164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "b494883c7500409eb7d3b400aca0ebf1"
format_stamp: "Formatted at 2026-08-09 23:19:20 on dist-test-slave-6nmv"
server_key: "e809575538bb9450dfe9a40e880848bd"
server_key_iv: "f9316404a185f49a4e8883e1cd11c892"
server_key_version: "encryptionkey@0"
I20260809 23:19:20.343050 7164 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "b494883c7500409eb7d3b400aca0ebf1"
format_stamp: "Formatted at 2026-08-09 23:19:20 on dist-test-slave-6nmv"
server_key: "e809575538bb9450dfe9a40e880848bd"
server_key_iv: "f9316404a185f49a4e8883e1cd11c892"
server_key_version: "encryptionkey@0"
I20260809 23:19:20.344332 7164 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:19:20.345057 7184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:20.345216 7164 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:20.345304 7164 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "b494883c7500409eb7d3b400aca0ebf1"
format_stamp: "Formatted at 2026-08-09 23:19:20 on dist-test-slave-6nmv"
server_key: "e809575538bb9450dfe9a40e880848bd"
server_key_iv: "f9316404a185f49a4e8883e1cd11c892"
server_key_version: "encryptionkey@0"
I20260809 23:19:20.345386 7164 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:20.348484 7164 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:20.348745 7164 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:20.348879 7164 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:20.349092 7164 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:20.349376 7164 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:20.349426 7164 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:20.349462 7164 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:20.349488 7164 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:20.355198 7164 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:33017
I20260809 23:19:20.355284 7313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:33017 every 8 connection(s)
I20260809 23:19:20.355551 7164 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:19:20.358125 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 7164
I20260809 23:19:20.358242 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:19:20.358393 7139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.356235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:47647 (local address 127.1.235.190:41811)
0809 23:19:20.356308 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:20.356310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:20.356503 (+ 193us) server_negotiation.cc:407] Connection header received
0809 23:19:20.356912 (+ 409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:20.356913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:20.356917 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:20.356965 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:20.358112 (+ 1147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:20.358113 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:20.358113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:19:20.358118 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:20.358133 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:19:20.358137 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:20.358185 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:20.358300 (+ 115us) server_negotiation.cc:299] Negotiation successful
0809 23:19:20.358316 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 23:19:20.358454 1966 external_mini_cluster.cc:1428] Setting key c2237d7f1291be7af5c38e24a2226297
I20260809 23:19:20.358580 7316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.356198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:41811 (local address 127.1.235.129:47647)
0809 23:19:20.356368 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:20.356401 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:20.356819 (+ 418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:20.357005 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:20.357008 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:20.357014 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:20.357944 (+ 930us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:19:20.357944 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:20.357981 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:19:20.358017 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:20.358209 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:20.358215 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:20.358218 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:19:20.358292 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 23:19:20.358356 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":90,"threads_started":1}
I20260809 23:19:20.359140 7314 heartbeater.cc:347] Connected to a master server at 127.1.235.190:41811
I20260809 23:19:20.359225 7314 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:20.359356 7314 heartbeater.cc:511] Master 127.1.235.190:41811 requested a full tablet report, sending...
I20260809 23:19:20.359400 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:41811
--builtin_ntp_servers=127.1.235.148:41603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 23:19:20.359838 7091 ts_manager.cc:194] Registered new tserver with Master: b494883c7500409eb7d3b400aca0ebf1 (127.1.235.129:33017)
W20260809 23:19:20.436688 7317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:20.436923 7317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:20.436959 7317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:20.438163 7317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:20.438221 7317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:20.438264 7317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:19:20.439617 7317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:41603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:41811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:20.439860 7317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:20.440163 7317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:20.445185 7325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:20.445267 7317 server_base.cc:1034] running on GCE node
W20260809 23:19:20.445250 7323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:20.445247 7322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:20.445597 7317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:20.445894 7317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:20.447062 7317 hybrid_clock.cc:648] HybridClock initialized: now 1786317560447054 us; error 45 us; skew 500 ppm
I20260809 23:19:20.448388 7317 webserver.cc:460] Webserver started at http://127.1.235.130:40755/ using document root <none> and password file <none>
I20260809 23:19:20.448685 7317 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:20.448750 7317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:20.448889 7317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:20.450001 7317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "f09739f9bc6f44bd8d477ad4590cdc7c"
format_stamp: "Formatted at 2026-08-09 23:19:20 on dist-test-slave-6nmv"
server_key: "d995687bbf2ab27009b996dc5408e5db"
server_key_iv: "ee8c8212e2c62090c5f579186da18543"
server_key_version: "encryptionkey@0"
I20260809 23:19:20.450393 7317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "f09739f9bc6f44bd8d477ad4590cdc7c"
format_stamp: "Formatted at 2026-08-09 23:19:20 on dist-test-slave-6nmv"
server_key: "d995687bbf2ab27009b996dc5408e5db"
server_key_iv: "ee8c8212e2c62090c5f579186da18543"
server_key_version: "encryptionkey@0"
I20260809 23:19:20.451752 7317 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:19:20.452543 7331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:20.452726 7317 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:20.452826 7317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "f09739f9bc6f44bd8d477ad4590cdc7c"
format_stamp: "Formatted at 2026-08-09 23:19:20 on dist-test-slave-6nmv"
server_key: "d995687bbf2ab27009b996dc5408e5db"
server_key_iv: "ee8c8212e2c62090c5f579186da18543"
server_key_version: "encryptionkey@0"
I20260809 23:19:20.452912 7317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:20.456238 7317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:20.456496 7317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:20.456629 7317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:20.456837 7317 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:20.457152 7317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:20.457206 7317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:20.457244 7317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:20.457270 7317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:20.463276 7317 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:36093
I20260809 23:19:20.463374 7457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:36093 every 8 connection(s)
I20260809 23:19:20.463653 7317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:19:20.464120 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 7317
I20260809 23:19:20.464238 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:19:20.464435 1966 external_mini_cluster.cc:1428] Setting key f3bf42519500985a2393bcf67e22cff1
I20260809 23:19:20.465924 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:41811
--builtin_ntp_servers=127.1.235.148:41603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 23:19:20.468230 7139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.465597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:48769 (local address 127.1.235.190:41811)
0809 23:19:20.465640 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:20.465642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:20.465976 (+ 334us) server_negotiation.cc:407] Connection header received
0809 23:19:20.466535 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:20.466536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:20.466544 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:20.466629 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:20.468009 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:20.468010 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:20.468010 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:19:20.468014 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:20.468030 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:19:20.468034 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:20.468086 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:20.468166 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 23:19:20.468178 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 23:19:20.468466 7460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.465614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:41811 (local address 127.1.235.130:48769)
0809 23:19:20.465800 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:20.465877 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:20.466411 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:20.466689 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:20.466692 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:20.466700 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:20.467827 (+ 1127us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:19:20.467828 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:20.467867 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:19:20.467904 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:20.468089 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:20.468094 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:20.468097 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:19:20.468177 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 23:19:20.468242 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":94,"threads_started":1}
I20260809 23:19:20.468938 7458 heartbeater.cc:347] Connected to a master server at 127.1.235.190:41811
I20260809 23:19:20.469007 7458 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:20.469188 7458 heartbeater.cc:511] Master 127.1.235.190:41811 requested a full tablet report, sending...
I20260809 23:19:20.469579 7091 ts_manager.cc:194] Registered new tserver with Master: f09739f9bc6f44bd8d477ad4590cdc7c (127.1.235.130:36093)
W20260809 23:19:20.543792 7461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:20.543991 7461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:20.544025 7461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:20.545127 7461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:20.545188 7461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:20.545229 7461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:19:20.546545 7461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:41603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:41811
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:20.546795 7461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:20.547066 7461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:20.551879 7466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:20.551930 7469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:20.552033 7461 server_base.cc:1034] running on GCE node
W20260809 23:19:20.551930 7467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:20.552282 7461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:20.552537 7461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:20.553723 7461 hybrid_clock.cc:648] HybridClock initialized: now 1786317560553723 us; error 38 us; skew 500 ppm
I20260809 23:19:20.554859 7461 webserver.cc:460] Webserver started at http://127.1.235.131:32947/ using document root <none> and password file <none>
I20260809 23:19:20.555112 7461 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:20.555181 7461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:20.555336 7461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:20.556296 7461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "87c10be0252848a2917d5eef188ba609"
format_stamp: "Formatted at 2026-08-09 23:19:20 on dist-test-slave-6nmv"
server_key: "d216bf4389f1206d0206d5e9cfd39509"
server_key_iv: "dff0a3d4e438c105a4495d909a03a296"
server_key_version: "encryptionkey@0"
I20260809 23:19:20.556725 7461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "87c10be0252848a2917d5eef188ba609"
format_stamp: "Formatted at 2026-08-09 23:19:20 on dist-test-slave-6nmv"
server_key: "d216bf4389f1206d0206d5e9cfd39509"
server_key_iv: "dff0a3d4e438c105a4495d909a03a296"
server_key_version: "encryptionkey@0"
I20260809 23:19:20.558039 7461 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:19:20.558732 7477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:20.558918 7461 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:20.559008 7461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "87c10be0252848a2917d5eef188ba609"
format_stamp: "Formatted at 2026-08-09 23:19:20 on dist-test-slave-6nmv"
server_key: "d216bf4389f1206d0206d5e9cfd39509"
server_key_iv: "dff0a3d4e438c105a4495d909a03a296"
server_key_version: "encryptionkey@0"
I20260809 23:19:20.559080 7461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:20.562314 7461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:20.562558 7461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:20.562701 7461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:20.562901 7461 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:20.563184 7461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:20.563237 7461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:20.563275 7461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:20.563303 7461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:20.569008 7461 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:33499
I20260809 23:19:20.569047 7602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:33499 every 8 connection(s)
I20260809 23:19:20.569329 7461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:19:20.571839 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 7461
I20260809 23:19:20.571944 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:19:20.572096 7139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.570038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:55563 (local address 127.1.235.190:41811)
0809 23:19:20.570118 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:20.570120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:20.570297 (+ 177us) server_negotiation.cc:407] Connection header received
0809 23:19:20.570687 (+ 390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:20.570687 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:20.570692 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:20.570741 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:20.571771 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:20.571772 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:20.571773 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:19:20.571777 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:20.571791 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:19:20.571795 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:20.571850 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:20.572012 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 23:19:20.572027 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 23:19:20.572126 1966 external_mini_cluster.cc:1428] Setting key f83c9569a3db0a47282cffc3e5f9bf23
I20260809 23:19:20.572239 7605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.570001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:41811 (local address 127.1.235.131:55563)
0809 23:19:20.570177 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:20.570213 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:20.570606 (+ 393us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:20.570795 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:20.570798 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:20.570806 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:20.571592 (+ 786us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:19:20.571592 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:20.571628 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:19:20.571668 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:20.571860 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:20.571865 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:20.571869 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:19:20.571979 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 23:19:20.572039 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":90,"threads_started":1}
I20260809 23:19:20.572750 7603 heartbeater.cc:347] Connected to a master server at 127.1.235.190:41811
I20260809 23:19:20.572851 7603 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:20.572988 7603 heartbeater.cc:511] Master 127.1.235.190:41811 requested a full tablet report, sending...
I20260809 23:19:20.573310 7091 ts_manager.cc:194] Registered new tserver with Master: 87c10be0252848a2917d5eef188ba609 (127.1.235.131:33499)
I20260809 23:19:20.583899 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:19:20.586293 7139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.585238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39280 (local address 127.1.235.190:41811)
0809 23:19:20.585300 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:20.585302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:20.585409 (+ 107us) server_negotiation.cc:407] Connection header received
0809 23:19:20.585475 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:20.585476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:20.585481 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:20.585529 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:20.586079 (+ 550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:20.586080 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:20.586080 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:19:20.586085 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:20.586098 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:19:20.586102 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:20.586159 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:20.586212 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 23:19:20.586224 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 23:19:20.587636 7091 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39280:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:19:20.589085 7091 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:19:20.592875 7616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.591364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:36093 (local address 127.0.0.1:50902)
0809 23:19:20.591475 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:20.591484 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:20.591520 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:20.591963 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:20.591965 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:20.591967 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:20.592418 (+ 451us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:19:20.592419 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:20.592434 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:19:20.592454 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:20.592709 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:20.592715 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:20.592718 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:19:20.592785 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 23:19:20.592798 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":69,"threads_started":1}
I20260809 23:19:20.592922 7617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.591570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50902 (local address 127.1.235.130:36093)
0809 23:19:20.591769 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:20.591773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:20.591783 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:19:20.591807 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:20.591809 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:20.591825 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:20.592148 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:20.592534 (+ 386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:20.592540 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:20.592540 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:19:20.592544 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:20.592575 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:19:20.592602 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:20.592715 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:20.592790 (+ 75us) server_negotiation.cc:299] Negotiation successful
0809 23:19:20.592808 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":130,"threads_started":1}
I20260809 23:19:20.592967 7613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.591157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:33017 (local address 127.0.0.1:38086)
0809 23:19:20.591470 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:20.591483 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:20.591543 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:20.592047 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:20.592048 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:20.592050 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:20.592559 (+ 509us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:19:20.592559 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:20.592567 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:19:20.592582 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:20.592825 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:20.592826 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:20.592827 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 23:19:20.592883 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 23:19:20.592895 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":94,"threads_started":1}
I20260809 23:19:20.593194 7614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.591273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38086 (local address 127.1.235.129:33017)
0809 23:19:20.591505 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:20.591509 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:20.591523 (+ 14us) server_negotiation.cc:407] Connection header received
0809 23:19:20.591635 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:20.591640 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:20.591665 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:20.591736 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:20.592666 (+ 930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:20.592676 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:20.592676 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:19:20.592680 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:20.592714 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:19:20.592741 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:20.592798 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:20.593055 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 23:19:20.593070 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":82,"threads_started":1}
I20260809 23:19:20.593231 7611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.591125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:33499 (local address 127.0.0.1:57660)
0809 23:19:20.591263 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:20.591313 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:20.591360 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:20.591767 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:20.591773 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:20.591779 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:20.592563 (+ 784us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:19:20.592563 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:20.592568 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:19:20.592580 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:20.593091 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:20.593092 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:20.593093 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 23:19:20.593141 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 23:19:20.593153 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260809 23:19:20.593257 7615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.591317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57660 (local address 127.1.235.131:33499)
0809 23:19:20.591589 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:20.591593 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:20.591602 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:19:20.591634 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:20.591636 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:20.591644 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:20.592661 (+ 1017us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:20.592912 (+ 251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:20.592915 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:20.592916 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:19:20.592919 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:20.592955 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:19:20.592969 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:20.593094 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:20.593155 (+ 61us) server_negotiation.cc:299] Negotiation successful
0809 23:19:20.593185 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":88,"threads_started":1}
I20260809 23:19:20.594008 7529 tablet_service.cc:1467] Processing CreateTablet for tablet 1f6792759b454cfcbf7300909dc6aa5e (DEFAULT_TABLE table=test-table [id=58691e3c4e2d4bd389fff0edc9fc52fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:20.594142 7237 tablet_service.cc:1467] Processing CreateTablet for tablet 1f6792759b454cfcbf7300909dc6aa5e (DEFAULT_TABLE table=test-table [id=58691e3c4e2d4bd389fff0edc9fc52fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:20.594161 7384 tablet_service.cc:1467] Processing CreateTablet for tablet 1f6792759b454cfcbf7300909dc6aa5e (DEFAULT_TABLE table=test-table [id=58691e3c4e2d4bd389fff0edc9fc52fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:20.594372 7529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f6792759b454cfcbf7300909dc6aa5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:20.594467 7384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f6792759b454cfcbf7300909dc6aa5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:20.594493 7237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f6792759b454cfcbf7300909dc6aa5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:20.596985 7618 tablet_bootstrap.cc:492] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1: Bootstrap starting.
I20260809 23:19:20.597429 7621 tablet_bootstrap.cc:492] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609: Bootstrap starting.
I20260809 23:19:20.597878 7618 tablet_bootstrap.cc:654] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:20.597992 7620 tablet_bootstrap.cc:492] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c: Bootstrap starting.
I20260809 23:19:20.598076 7621 tablet_bootstrap.cc:654] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:20.598240 7618 log.cc:824] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:20.598376 7621 log.cc:824] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:20.598771 7620 tablet_bootstrap.cc:654] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:20.599035 7618 tablet_bootstrap.cc:492] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1: No bootstrap required, opened a new log
I20260809 23:19:20.599097 7618 ts_tablet_manager.cc:1397] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 23:19:20.599080 7620 log.cc:824] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:20.599723 7620 tablet_bootstrap.cc:492] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c: No bootstrap required, opened a new log
I20260809 23:19:20.599799 7620 ts_tablet_manager.cc:1397] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:19:20.600926 7618 raft_consensus.cc:348] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87c10be0252848a2917d5eef188ba609" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 33499 } } peers { permanent_uuid: "b494883c7500409eb7d3b400aca0ebf1" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 33017 } } peers { permanent_uuid: "f09739f9bc6f44bd8d477ad4590cdc7c" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36093 } }
I20260809 23:19:20.601076 7618 raft_consensus.cc:374] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:20.601121 7618 raft_consensus.cc:729] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b494883c7500409eb7d3b400aca0ebf1, State: Initialized, Role: FOLLOWER
I20260809 23:19:20.601222 7618 consensus_queue.cc:260] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87c10be0252848a2917d5eef188ba609" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 33499 } } peers { permanent_uuid: "b494883c7500409eb7d3b400aca0ebf1" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 33017 } } peers { permanent_uuid: "f09739f9bc6f44bd8d477ad4590cdc7c" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36093 } }
I20260809 23:19:20.601495 7618 ts_tablet_manager.cc:1428] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 23:19:20.601504 7314 heartbeater.cc:503] Master 127.1.235.190:41811 was elected leader, sending a full tablet report...
I20260809 23:19:20.601930 7621 tablet_bootstrap.cc:492] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609: No bootstrap required, opened a new log
I20260809 23:19:20.601986 7621 ts_tablet_manager.cc:1397] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260809 23:19:20.602720 7620 raft_consensus.cc:348] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87c10be0252848a2917d5eef188ba609" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 33499 } } peers { permanent_uuid: "b494883c7500409eb7d3b400aca0ebf1" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 33017 } } peers { permanent_uuid: "f09739f9bc6f44bd8d477ad4590cdc7c" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36093 } }
I20260809 23:19:20.602878 7620 raft_consensus.cc:374] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:20.602916 7620 raft_consensus.cc:729] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f09739f9bc6f44bd8d477ad4590cdc7c, State: Initialized, Role: FOLLOWER
I20260809 23:19:20.603097 7620 consensus_queue.cc:260] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87c10be0252848a2917d5eef188ba609" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 33499 } } peers { permanent_uuid: "b494883c7500409eb7d3b400aca0ebf1" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 33017 } } peers { permanent_uuid: "f09739f9bc6f44bd8d477ad4590cdc7c" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36093 } }
I20260809 23:19:20.603386 7620 ts_tablet_manager.cc:1428] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260809 23:19:20.603410 7458 heartbeater.cc:503] Master 127.1.235.190:41811 was elected leader, sending a full tablet report...
I20260809 23:19:20.604760 7621 raft_consensus.cc:348] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87c10be0252848a2917d5eef188ba609" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 33499 } } peers { permanent_uuid: "b494883c7500409eb7d3b400aca0ebf1" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 33017 } } peers { permanent_uuid: "f09739f9bc6f44bd8d477ad4590cdc7c" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36093 } }
I20260809 23:19:20.605540 7621 raft_consensus.cc:374] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:20.605574 7621 raft_consensus.cc:729] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87c10be0252848a2917d5eef188ba609, State: Initialized, Role: FOLLOWER
I20260809 23:19:20.605676 7621 consensus_queue.cc:260] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87c10be0252848a2917d5eef188ba609" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 33499 } } peers { permanent_uuid: "b494883c7500409eb7d3b400aca0ebf1" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 33017 } } peers { permanent_uuid: "f09739f9bc6f44bd8d477ad4590cdc7c" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36093 } }
I20260809 23:19:20.605929 7621 ts_tablet_manager.cc:1428] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260809 23:19:20.605952 7603 heartbeater.cc:503] Master 127.1.235.190:41811 was elected leader, sending a full tablet report...
W20260809 23:19:20.606295 7315 tablet.cc:2369] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:19:20.633170 7625 raft_consensus.cc:482] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:19:20.633297 7625 raft_consensus.cc:504] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87c10be0252848a2917d5eef188ba609" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 33499 } } peers { permanent_uuid: "b494883c7500409eb7d3b400aca0ebf1" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 33017 } } peers { permanent_uuid: "f09739f9bc6f44bd8d477ad4590cdc7c" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36093 } }
I20260809 23:19:20.633644 7625 leader_election.cc:288] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87c10be0252848a2917d5eef188ba609 (127.1.235.131:33499), f09739f9bc6f44bd8d477ad4590cdc7c (127.1.235.130:36093)
I20260809 23:19:20.640558 7316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.633871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:33499 (local address 127.1.235.129:53283)
0809 23:19:20.633920 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:20.633932 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:20.633967 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:20.634106 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:20.634106 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:20.634108 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:20.640187 (+ 6079us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:19:20.640187 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:20.640195 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:19:20.640207 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:20.640397 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:20.640398 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:20.640399 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 23:19:20.640456 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 23:19:20.640470 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 23:19:20.640573 7615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.633932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:53283 (local address 127.1.235.131:33499)
0809 23:19:20.633984 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:20.633985 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:20.633993 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:19:20.634020 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:20.634020 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:20.634026 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:20.634102 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:20.640292 (+ 6190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:20.640293 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:20.640293 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:19:20.640298 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:20.640315 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:19:20.640320 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:20.640380 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:20.640479 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 23:19:20.640494 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 23:19:20.640635 7617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.633934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:39067 (local address 127.1.235.130:36093)
0809 23:19:20.633978 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:20.633980 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:20.634190 (+ 210us) server_negotiation.cc:407] Connection header received
0809 23:19:20.634228 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:20.634229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:20.634234 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:20.634299 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:20.640389 (+ 6090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:20.640391 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:20.640391 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:19:20.640396 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:20.640413 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:19:20.640418 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:20.640475 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:20.640548 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 23:19:20.640561 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:19:20.640846 7628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.633872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:36093 (local address 127.1.235.129:39067)
0809 23:19:20.634052 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:20.634062 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:20.634120 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:20.634299 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:20.634300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:20.634301 (+ 1us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:20.640263 (+ 5962us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:19:20.640264 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:20.640273 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:19:20.640288 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:20.640485 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:20.640486 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:20.640487 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 23:19:20.640541 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 23:19:20.640554 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":11,"thread_start_us":96,"threads_started":1}
I20260809 23:19:20.640861 7550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f6792759b454cfcbf7300909dc6aa5e" candidate_uuid: "b494883c7500409eb7d3b400aca0ebf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87c10be0252848a2917d5eef188ba609" is_pre_election: true
I20260809 23:19:20.641006 7550 raft_consensus.cc:2454] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b494883c7500409eb7d3b400aca0ebf1 in term 0.
I20260809 23:19:20.641194 7407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f6792759b454cfcbf7300909dc6aa5e" candidate_uuid: "b494883c7500409eb7d3b400aca0ebf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f09739f9bc6f44bd8d477ad4590cdc7c" is_pre_election: true
I20260809 23:19:20.641294 7189 leader_election.cc:302] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87c10be0252848a2917d5eef188ba609, b494883c7500409eb7d3b400aca0ebf1; no voters:
I20260809 23:19:20.641346 7407 raft_consensus.cc:2454] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b494883c7500409eb7d3b400aca0ebf1 in term 0.
I20260809 23:19:20.641408 7625 raft_consensus.cc:2781] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:19:20.641480 7625 raft_consensus.cc:482] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:19:20.641510 7625 raft_consensus.cc:3037] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:20.642352 7625 raft_consensus.cc:504] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87c10be0252848a2917d5eef188ba609" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 33499 } } peers { permanent_uuid: "b494883c7500409eb7d3b400aca0ebf1" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 33017 } } peers { permanent_uuid: "f09739f9bc6f44bd8d477ad4590cdc7c" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36093 } }
I20260809 23:19:20.642494 7625 leader_election.cc:288] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [CANDIDATE]: Term 1 election: Requested vote from peers 87c10be0252848a2917d5eef188ba609 (127.1.235.131:33499), f09739f9bc6f44bd8d477ad4590cdc7c (127.1.235.130:36093)
I20260809 23:19:20.642652 7407 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f6792759b454cfcbf7300909dc6aa5e" candidate_uuid: "b494883c7500409eb7d3b400aca0ebf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f09739f9bc6f44bd8d477ad4590cdc7c"
I20260809 23:19:20.642671 7550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f6792759b454cfcbf7300909dc6aa5e" candidate_uuid: "b494883c7500409eb7d3b400aca0ebf1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87c10be0252848a2917d5eef188ba609"
I20260809 23:19:20.642729 7550 raft_consensus.cc:3037] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:20.642729 7407 raft_consensus.cc:3037] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:20.643574 7407 raft_consensus.cc:2454] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b494883c7500409eb7d3b400aca0ebf1 in term 1.
I20260809 23:19:20.643574 7550 raft_consensus.cc:2454] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b494883c7500409eb7d3b400aca0ebf1 in term 1.
I20260809 23:19:20.643740 7186 leader_election.cc:302] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b494883c7500409eb7d3b400aca0ebf1, f09739f9bc6f44bd8d477ad4590cdc7c; no voters:
I20260809 23:19:20.643831 7625 raft_consensus.cc:2781] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:20.643981 7625 raft_consensus.cc:686] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [term 1 LEADER]: Becoming Leader. State: Replica: b494883c7500409eb7d3b400aca0ebf1, State: Running, Role: LEADER
I20260809 23:19:20.644101 7625 consensus_queue.cc:237] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87c10be0252848a2917d5eef188ba609" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 33499 } } peers { permanent_uuid: "b494883c7500409eb7d3b400aca0ebf1" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 33017 } } peers { permanent_uuid: "f09739f9bc6f44bd8d477ad4590cdc7c" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36093 } }
I20260809 23:19:20.644838 7091 catalog_manager.cc:5495] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b494883c7500409eb7d3b400aca0ebf1 (127.1.235.129). New cstate: current_term: 1 leader_uuid: "b494883c7500409eb7d3b400aca0ebf1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87c10be0252848a2917d5eef188ba609" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 33499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b494883c7500409eb7d3b400aca0ebf1" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f09739f9bc6f44bd8d477ad4590cdc7c" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36093 } health_report { overall_health: UNKNOWN } } }
I20260809 23:19:20.653221 7614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.652184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38102 (local address 127.1.235.129:33017)
0809 23:19:20.652238 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:20.652240 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:20.652247 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:19:20.652272 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:20.652272 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:20.652281 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:20.652326 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:20.652964 (+ 638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:20.652966 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:20.652966 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:19:20.652970 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:20.652983 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:19:20.652986 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:20.653039 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:20.653107 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 23:19:20.653145 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 23:19:20.654678 7550 raft_consensus.cc:1261] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609 [term 1 FOLLOWER]: Refusing update from remote peer b494883c7500409eb7d3b400aca0ebf1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:20.654678 7407 raft_consensus.cc:1261] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c [term 1 FOLLOWER]: Refusing update from remote peer b494883c7500409eb7d3b400aca0ebf1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:20.655036 7629 consensus_queue.cc:1035] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f09739f9bc6f44bd8d477ad4590cdc7c" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:20.655169 7625 consensus_queue.cc:1035] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87c10be0252848a2917d5eef188ba609" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 33499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:20.657660 7633 mvcc.cc:205] Tried to move back new op lower bound from 7316756728439455744 to 7316756728398802944. Current Snapshot: MvccSnapshot[applied={T|T < 7316756728439455744 or (T in {7316756728439455744})}]
I20260809 23:19:20.659212 7092 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39280:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:20.659305 7092 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39280:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:20.659967 7092 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a087e4f0cd3444e798d257246c58af38: Sending DeleteTablet for 3 replicas of tablet 1f6792759b454cfcbf7300909dc6aa5e
I20260809 23:19:20.660310 7529 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f6792759b454cfcbf7300909dc6aa5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:20 UTC) from {username='slave'} at 127.0.0.1:57660
I20260809 23:19:20.660372 7237 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f6792759b454cfcbf7300909dc6aa5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:20 UTC) from {username='slave'} at 127.0.0.1:38086
I20260809 23:19:20.660588 7642 tablet_replica.cc:330] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1: stopping tablet replica
I20260809 23:19:20.660703 7642 raft_consensus.cc:2229] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:19:20.660792 7642 raft_consensus.cc:2258] T 1f6792759b454cfcbf7300909dc6aa5e P b494883c7500409eb7d3b400aca0ebf1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:20.660789 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 7164
I20260809 23:19:20.663816 7384 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f6792759b454cfcbf7300909dc6aa5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:20 UTC) from {username='slave'} at 127.0.0.1:50902
I20260809 23:19:20.664238 7643 tablet_replica.cc:330] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c: stopping tablet replica
I20260809 23:19:20.664237 7641 tablet_replica.cc:330] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609: stopping tablet replica
I20260809 23:19:20.664327 7643 raft_consensus.cc:2229] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:20.664328 7641 raft_consensus.cc:2229] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:20.664418 7641 raft_consensus.cc:2258] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:20.664418 7643 raft_consensus.cc:2258] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:20.664825 7643 ts_tablet_manager.cc:1905] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:20.664937 7641 ts_tablet_manager.cc:1905] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:20.666111 7643 ts_tablet_manager.cc:1918] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:19:20.666200 7643 log.cc:1196] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/1f6792759b454cfcbf7300909dc6aa5e
I20260809 23:19:20.666442 7643 ts_tablet_manager.cc:1939] T 1f6792759b454cfcbf7300909dc6aa5e P f09739f9bc6f44bd8d477ad4590cdc7c: Deleting consensus metadata
I20260809 23:19:20.666779 7075 catalog_manager.cc:4841] TS f09739f9bc6f44bd8d477ad4590cdc7c (127.1.235.130:36093): tablet 1f6792759b454cfcbf7300909dc6aa5e (table test-table [id=58691e3c4e2d4bd389fff0edc9fc52fe]) successfully deleted
I20260809 23:19:20.667028 7641 ts_tablet_manager.cc:1918] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:19:20.667133 7641 log.cc:1196] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/1f6792759b454cfcbf7300909dc6aa5e
I20260809 23:19:20.667451 7641 ts_tablet_manager.cc:1939] T 1f6792759b454cfcbf7300909dc6aa5e P 87c10be0252848a2917d5eef188ba609: Deleting consensus metadata
I20260809 23:19:20.667898 7078 catalog_manager.cc:4841] TS 87c10be0252848a2917d5eef188ba609 (127.1.235.131:33499): tablet 1f6792759b454cfcbf7300909dc6aa5e (table test-table [id=58691e3c4e2d4bd389fff0edc9fc52fe]) successfully deleted
W20260809 23:19:20.674511 7075 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.235.129:33017 (error 108)
I20260809 23:19:20.674769 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 7317
I20260809 23:19:20.675034 7611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.674927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:33017 (local address 127.0.0.1:38104)
0809 23:19:20.674969 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:20.675004 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.129:33017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260809 23:19:20.675469 7075 catalog_manager.cc:4584] TS b494883c7500409eb7d3b400aca0ebf1 (127.1.235.129:33017): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1f6792759b454cfcbf7300909dc6aa5e: Network error: Client connection negotiation failed: client connection to 127.1.235.129:33017: connect: Connection refused (error 111)
I20260809 23:19:20.682178 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 7461
I20260809 23:19:20.687142 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 7060
2026-08-09T23:19:20Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (621 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 23:19:20.707396 1966 mini_oidc.cc:152] Starting JWKS server
I20260809 23:19:20.708483 1966 webserver.cc:460] Webserver started at https://127.0.0.1:35011/ using document root <none> and password file <none>
I20260809 23:19:20.708555 1966 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 23:19:20.708679 1966 webserver.cc:460] Webserver started at http://127.0.0.1:44161/ using document root <none> and password file <none>
2026-08-09T23:19:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:19:20Z Disabled control of system clock
I20260809 23:19:20.716205 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:36645
--webserver_interface=127.1.235.190
--webserver_port=0
--builtin_ntp_servers=127.1.235.148:33305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:36645
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35011/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/testchainca.cert with env {}
W20260809 23:19:20.791826 7651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:20.792008 7651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:20.792029 7651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:20.793056 7651 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:20.793118 7651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:20.793129 7651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:20.793140 7651 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:20.793151 7651 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 23:19:20.793162 7651 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 23:19:20.793172 7651 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35011/jwks.json
I20260809 23:19:20.794483 7651 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:33305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:36645
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:36645
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35011/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:20.794651 7651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:20.794806 7651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:20.799305 7661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:20.799362 7651 server_base.cc:1034] running on GCE node
W20260809 23:19:20.799280 7658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:20.799271 7657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:20.799741 7651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:20.800041 7651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:20.801187 7651 hybrid_clock.cc:648] HybridClock initialized: now 1786317560801175 us; error 48 us; skew 500 ppm
I20260809 23:19:20.802314 7651 webserver.cc:460] Webserver started at http://127.1.235.190:39747/ using document root <none> and password file <none>
I20260809 23:19:20.802549 7651 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:20.802614 7651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:20.802738 7651 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:20.803716 7651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "9ff5d63f193340cd8cf8d7ba9627ce6b"
format_stamp: "Formatted at 2026-08-09 23:19:20 on dist-test-slave-6nmv"
server_key: "c04ae0cc84e913d169521bb3eb2ae9ed"
server_key_iv: "cb0fe5eb2b429d261885f806e5a73c36"
server_key_version: "encryptionkey@0"
I20260809 23:19:20.804106 7651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "9ff5d63f193340cd8cf8d7ba9627ce6b"
format_stamp: "Formatted at 2026-08-09 23:19:20 on dist-test-slave-6nmv"
server_key: "c04ae0cc84e913d169521bb3eb2ae9ed"
server_key_iv: "cb0fe5eb2b429d261885f806e5a73c36"
server_key_version: "encryptionkey@0"
I20260809 23:19:20.805279 7651 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:19:20.805994 7668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:20.806166 7651 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:20.806260 7651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "9ff5d63f193340cd8cf8d7ba9627ce6b"
format_stamp: "Formatted at 2026-08-09 23:19:20 on dist-test-slave-6nmv"
server_key: "c04ae0cc84e913d169521bb3eb2ae9ed"
server_key_iv: "cb0fe5eb2b429d261885f806e5a73c36"
server_key_version: "encryptionkey@0"
I20260809 23:19:20.806339 7651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:20.815995 7651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:20.816256 7651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:20.816392 7651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:20.820215 7651 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:36645
I20260809 23:19:20.820264 7736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:36645 every 8 connection(s)
I20260809 23:19:20.820576 7651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:19:20.821540 7737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:20.823467 7737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b: Bootstrap starting.
I20260809 23:19:20.823935 7737 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:20.824195 7737 log.cc:824] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:20.824827 7737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b: No bootstrap required, opened a new log
I20260809 23:19:20.826388 7737 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ff5d63f193340cd8cf8d7ba9627ce6b" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 36645 } }
I20260809 23:19:20.826502 7737 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:20.826522 7737 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ff5d63f193340cd8cf8d7ba9627ce6b, State: Initialized, Role: FOLLOWER
I20260809 23:19:20.826638 7737 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ff5d63f193340cd8cf8d7ba9627ce6b" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 36645 } }
I20260809 23:19:20.826710 7737 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:19:20.826730 7737 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:19:20.826754 7737 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:20.827193 7737 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ff5d63f193340cd8cf8d7ba9627ce6b" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 36645 } }
I20260809 23:19:20.827280 7737 leader_election.cc:302] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ff5d63f193340cd8cf8d7ba9627ce6b; no voters:
I20260809 23:19:20.827476 7737 leader_election.cc:288] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:19:20.827664 7741 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:20.827740 7737 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:20.827874 7741 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [term 1 LEADER]: Becoming Leader. State: Replica: 9ff5d63f193340cd8cf8d7ba9627ce6b, State: Running, Role: LEADER
I20260809 23:19:20.827999 7741 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ff5d63f193340cd8cf8d7ba9627ce6b" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 36645 } }
I20260809 23:19:20.828857 7740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ff5d63f193340cd8cf8d7ba9627ce6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ff5d63f193340cd8cf8d7ba9627ce6b" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 36645 } } }
I20260809 23:19:20.828943 7740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:20.829000 7742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ff5d63f193340cd8cf8d7ba9627ce6b. Latest consensus state: current_term: 1 leader_uuid: "9ff5d63f193340cd8cf8d7ba9627ce6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ff5d63f193340cd8cf8d7ba9627ce6b" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 36645 } } }
I20260809 23:19:20.829321 7742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b [sys.catalog]: This master's current role is: LEADER
W20260809 23:19:20.829468 7756 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 23:19:20.829504 7756 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:19:20.829566 7759 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:19:20.829752 7759 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:19:20.830073 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 7651
I20260809 23:19:20.830193 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:19:20.830376 1966 external_mini_cluster.cc:1428] Setting key ea60cae6aec339fb43783199c100c3c7
I20260809 23:19:20.831223 7759 catalog_manager.cc:1347] Generated new cluster ID: 8da6dcd73a3a4ca7aefc1fd1c135b12c
I20260809 23:19:20.831280 7759 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:19:20.836153 7762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.830930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57984 (local address 127.1.235.190:36645)
0809 23:19:20.831234 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:20.831243 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:20.831275 (+ 32us) server_negotiation.cc:407] Connection header received
0809 23:19:20.831394 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:20.831401 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:20.831475 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:20.831603 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:20.831870 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:20.833165 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:20.834276 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:20.834821 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:20.834920 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:20.835544 (+ 624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:20.835547 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:20.835547 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:19:20.835720 (+ 173us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:20.835756 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:19:20.835768 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:20.835826 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:20.835916 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 23:19:20.835978 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":62,"threads_started":1}
I20260809 23:19:20.836892 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:19:20.839673 7759 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:19:20.840158 7759 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:19:20.841822 7759 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ff5d63f193340cd8cf8d7ba9627ce6b: Generated new TSK 0
I20260809 23:19:20.841962 7759 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 23:19:20.871181 7770 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 23:19:20.871304 7770 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 23:19:20.871426 7762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:20.848877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57986 (local address 127.1.235.190:36645)
0809 23:19:20.848911 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:20.848913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:20.849076 (+ 163us) server_negotiation.cc:407] Connection header received
0809 23:19:20.849186 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:20.849187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:20.849195 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:20.849251 (+ 56us) server_negotiation.cc:226] Negotiated authn=JWT
0809 23:19:20.849416 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:20.849882 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:20.851008 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:20.851180 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:20.851227 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:20.851451 (+ 224us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 23:19:20.871174 (+ 19723us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35011/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 23:19:20.871343 (+ 169us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57986: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35011/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 23:19:20.871482 7762 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57986: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35011/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 23:19:20.871819 7769 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:19:20.848791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:36645 (local address 127.0.0.1:57986)
0809 23:19:20.848968 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:20.848979 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:20.849088 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:20.849262 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:20.849263 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:20.849268 (+ 5us) client_negotiation.cc:189] Negotiated authn=JWT
0809 23:19:20.849336 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:20.849337 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:20.849989 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:20.849990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:20.850930 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:20.850933 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:20.851263 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:20.851264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:20.851340 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:20.851359 (+ 19us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 23:19:20.871309 (+ 19950us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35011/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 23:19:20.871421 (+ 112us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.235.190:36645: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35011/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":87,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.1.235.190:36645: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35011/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 23:19:20.872219 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 7651
2026-08-09T23:19:20Z chronyd exiting
I20260809 23:19:20.910147 1966 test_util.cc:175] -----------------------------------------------
I20260809 23:19:20.910243 1966 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786317539151495-1966-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (203 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 23:19:20.911003 1966 mini_oidc.cc:152] Starting JWKS server
I20260809 23:19:20.911698 1966 webserver.cc:460] Webserver started at https://127.0.0.1:39293/ using document root <none> and password file <none>
I20260809 23:19:20.911767 1966 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 23:19:20.912009 1966 webserver.cc:460] Webserver started at http://127.0.0.1:35323/ using document root <none> and password file <none>
2026-08-09T23:19:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:19:20Z Disabled control of system clock
I20260809 23:19:20.919891 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:38283
--webserver_interface=127.1.235.190
--webserver_port=0
--builtin_ntp_servers=127.1.235.148:35397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:38283
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39293/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/testchainca.cert with env {}
W20260809 23:19:20.995187 7777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:20.995353 7777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:20.995373 7777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:20.996407 7777 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:20.996448 7777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:20.996460 7777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:20.996472 7777 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:20.996520 7777 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 23:19:20.996538 7777 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 23:19:20.996562 7777 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39293/jwks.json
I20260809 23:19:20.997933 7777 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:35397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:38283
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:38283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39293/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7777
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:20.998095 7777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:20.998317 7777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:21.002754 7784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:21.002849 7785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:21.002911 7777 server_base.cc:1034] running on GCE node
W20260809 23:19:21.002849 7790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:21.003216 7777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:21.003512 7777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:21.004668 7777 hybrid_clock.cc:648] HybridClock initialized: now 1786317561004648 us; error 55 us; skew 500 ppm
I20260809 23:19:21.010131 7777 webserver.cc:460] Webserver started at http://127.1.235.190:43433/ using document root <none> and password file <none>
I20260809 23:19:21.010392 7777 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:21.010463 7777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:21.010615 7777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:21.011699 7777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "9f12e55e5c314b0ab1f387f031b0d853"
format_stamp: "Formatted at 2026-08-09 23:19:21 on dist-test-slave-6nmv"
server_key: "d5a5b0279b7bbfc45e1743edac257114"
server_key_iv: "f388fb50a709055605909c0cceae0035"
server_key_version: "encryptionkey@0"
I20260809 23:19:21.012042 7777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "9f12e55e5c314b0ab1f387f031b0d853"
format_stamp: "Formatted at 2026-08-09 23:19:21 on dist-test-slave-6nmv"
server_key: "d5a5b0279b7bbfc45e1743edac257114"
server_key_iv: "f388fb50a709055605909c0cceae0035"
server_key_version: "encryptionkey@0"
I20260809 23:19:21.013357 7777 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:19:21.014122 7796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:21.014287 7777 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:19:21.014402 7777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "9f12e55e5c314b0ab1f387f031b0d853"
format_stamp: "Formatted at 2026-08-09 23:19:21 on dist-test-slave-6nmv"
server_key: "d5a5b0279b7bbfc45e1743edac257114"
server_key_iv: "f388fb50a709055605909c0cceae0035"
server_key_version: "encryptionkey@0"
I20260809 23:19:21.014474 7777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:21.037324 7777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:21.037603 7777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:21.037745 7777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:21.041535 7777 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:38283
I20260809 23:19:21.041572 7856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:38283 every 8 connection(s)
I20260809 23:19:21.041886 7777 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:19:21.042701 7857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:21.043922 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 7777
I20260809 23:19:21.044025 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:19:21.044202 1966 external_mini_cluster.cc:1428] Setting key ff8f9a0db15195ee743d69c7860f5b3e
I20260809 23:19:21.045181 7857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853: Bootstrap starting.
I20260809 23:19:21.045799 7857 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:21.046116 7857 log.cc:824] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:21.046900 7857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853: No bootstrap required, opened a new log
I20260809 23:19:21.048594 7857 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f12e55e5c314b0ab1f387f031b0d853" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38283 } }
I20260809 23:19:21.048739 7857 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:21.048789 7857 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f12e55e5c314b0ab1f387f031b0d853, State: Initialized, Role: FOLLOWER
I20260809 23:19:21.048949 7857 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f12e55e5c314b0ab1f387f031b0d853" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38283 } }
I20260809 23:19:21.049057 7857 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:19:21.049091 7857 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:19:21.049140 7857 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:21.049595 7860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:21.044693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48186 (local address 127.1.235.190:38283)
0809 23:19:21.044873 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:21.044879 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:21.044900 (+ 21us) server_negotiation.cc:407] Connection header received
0809 23:19:21.045319 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:21.045327 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:21.045391 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:21.045494 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:21.045739 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.046915 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.047719 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.048134 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.048270 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:21.048906 (+ 636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:21.048909 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:21.048910 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:19:21.049107 (+ 197us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:21.049153 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:19:21.049167 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:21.049238 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:21.049308 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 23:19:21.049385 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":83,"threads_started":1}
I20260809 23:19:21.049790 7857 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f12e55e5c314b0ab1f387f031b0d853" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38283 } }
I20260809 23:19:21.050092 7857 leader_election.cc:302] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f12e55e5c314b0ab1f387f031b0d853; no voters:
I20260809 23:19:21.050243 7857 leader_election.cc:288] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:19:21.050280 7862 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:21.050431 7862 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [term 1 LEADER]: Becoming Leader. State: Replica: 9f12e55e5c314b0ab1f387f031b0d853, State: Running, Role: LEADER
I20260809 23:19:21.050524 7862 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f12e55e5c314b0ab1f387f031b0d853" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38283 } }
I20260809 23:19:21.050642 7857 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:21.050654 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:19:21.050835 7862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f12e55e5c314b0ab1f387f031b0d853. Latest consensus state: current_term: 1 leader_uuid: "9f12e55e5c314b0ab1f387f031b0d853" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f12e55e5c314b0ab1f387f031b0d853" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38283 } } }
I20260809 23:19:21.050901 7862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:21.051152 7867 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:19:21.051728 7867 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:19:21.052030 7863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f12e55e5c314b0ab1f387f031b0d853" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f12e55e5c314b0ab1f387f031b0d853" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38283 } } }
I20260809 23:19:21.052253 7863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:21.053392 7867 catalog_manager.cc:1347] Generated new cluster ID: adb6cf9da23c4a49aa2021ee8fad78e6
I20260809 23:19:21.053445 7867 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:19:21.071256 7867 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:19:21.071734 7867 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:19:21.075421 7867 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9f12e55e5c314b0ab1f387f031b0d853: Generated new TSK 0
I20260809 23:19:21.075585 7867 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 23:19:21.104888 7889 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 23:19:21.104951 7889 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 23:19:21.105182 7860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:21.084349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48190 (local address 127.1.235.190:38283)
0809 23:19:21.084388 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:21.084390 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:21.084493 (+ 103us) server_negotiation.cc:407] Connection header received
0809 23:19:21.084543 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:21.084544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:21.084553 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:21.084608 (+ 55us) server_negotiation.cc:226] Negotiated authn=JWT
0809 23:19:21.084733 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.085199 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.086314 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.086487 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.086538 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:21.086706 (+ 168us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 23:19:21.105009 (+ 18303us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39293/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 23:19:21.105139 (+ 130us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48190: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39293/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":18}
W20260809 23:19:21.105243 7860 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48190: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39293/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260809 23:19:21.105301 7888 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:19:21.084252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38283 (local address 127.0.0.1:48190)
0809 23:19:21.084409 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:21.084420 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:21.084485 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:21.084614 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:21.084614 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:21.084616 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0809 23:19:21.084674 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:21.084675 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.085273 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.085274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:21.086232 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:21.086235 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.086553 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.086554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:21.086617 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:21.086622 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 23:19:21.105109 (+ 18487us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39293/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 23:19:21.105202 (+ 93us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.235.190:38283: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39293/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":90,"threads_started":1}
I20260809 23:19:21.105566 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 7777
2026-08-09T23:19:21Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (235 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 23:19:21.147028 1966 mini_oidc.cc:152] Starting JWKS server
I20260809 23:19:21.148023 1966 webserver.cc:460] Webserver started at https://127.0.0.1:36327/ using document root <none> and password file <none>
I20260809 23:19:21.148087 1966 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 23:19:21.148269 1966 webserver.cc:460] Webserver started at http://127.0.0.1:40119/ using document root <none> and password file <none>
2026-08-09T23:19:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:19:21Z Disabled control of system clock
I20260809 23:19:21.158876 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:41725
--webserver_interface=127.1.235.190
--webserver_port=0
--builtin_ntp_servers=127.1.235.148:40451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:41725
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36327/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 23:19:21.236142 7896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:21.236356 7896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:21.236392 7896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:21.237522 7896 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:21.237584 7896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:21.237608 7896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:21.237629 7896 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:21.237656 7896 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 23:19:21.237687 7896 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 23:19:21.237709 7896 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36327/jwks.json
I20260809 23:19:21.239061 7896 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:40451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:41725
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:41725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36327/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:21.239319 7896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:21.239585 7896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:21.244362 7906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:21.244449 7896 server_base.cc:1034] running on GCE node
W20260809 23:19:21.244370 7902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:21.244371 7903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:21.244906 7896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:21.245180 7896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:21.246335 7896 hybrid_clock.cc:648] HybridClock initialized: now 1786317561246317 us; error 30 us; skew 500 ppm
I20260809 23:19:21.247475 7896 webserver.cc:460] Webserver started at http://127.1.235.190:41143/ using document root <none> and password file <none>
I20260809 23:19:21.247726 7896 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:21.247802 7896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:21.247900 7896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:21.248929 7896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "dbb0d8f0789e4cc9a71057214cb4896e"
format_stamp: "Formatted at 2026-08-09 23:19:21 on dist-test-slave-6nmv"
server_key: "74d47cb3cc3bdb84f067b1b2c3f7afa4"
server_key_iv: "5d3a8623c698fa9e6830b6ce6112ab3b"
server_key_version: "encryptionkey@0"
I20260809 23:19:21.249236 7896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "dbb0d8f0789e4cc9a71057214cb4896e"
format_stamp: "Formatted at 2026-08-09 23:19:21 on dist-test-slave-6nmv"
server_key: "74d47cb3cc3bdb84f067b1b2c3f7afa4"
server_key_iv: "5d3a8623c698fa9e6830b6ce6112ab3b"
server_key_version: "encryptionkey@0"
I20260809 23:19:21.250559 7896 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:19:21.251344 7912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:21.251518 7896 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:21.251626 7896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "dbb0d8f0789e4cc9a71057214cb4896e"
format_stamp: "Formatted at 2026-08-09 23:19:21 on dist-test-slave-6nmv"
server_key: "74d47cb3cc3bdb84f067b1b2c3f7afa4"
server_key_iv: "5d3a8623c698fa9e6830b6ce6112ab3b"
server_key_version: "encryptionkey@0"
I20260809 23:19:21.251730 7896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:21.259616 7896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:21.259876 7896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:21.260023 7896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:21.263728 7896 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:41725
I20260809 23:19:21.263757 7973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:41725 every 8 connection(s)
I20260809 23:19:21.264050 7896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:19:21.264627 7974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:21.267217 7974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e: Bootstrap starting.
I20260809 23:19:21.267729 7974 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:21.267992 7974 log.cc:824] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:21.268612 7974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e: No bootstrap required, opened a new log
I20260809 23:19:21.270131 7974 raft_consensus.cc:348] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbb0d8f0789e4cc9a71057214cb4896e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41725 } }
I20260809 23:19:21.270275 7974 raft_consensus.cc:374] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:21.270316 7974 raft_consensus.cc:729] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbb0d8f0789e4cc9a71057214cb4896e, State: Initialized, Role: FOLLOWER
I20260809 23:19:21.270486 7974 consensus_queue.cc:260] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbb0d8f0789e4cc9a71057214cb4896e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41725 } }
I20260809 23:19:21.270565 7974 raft_consensus.cc:388] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:19:21.270612 7974 raft_consensus.cc:482] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:19:21.270661 7974 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:21.271188 7974 raft_consensus.cc:504] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbb0d8f0789e4cc9a71057214cb4896e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41725 } }
I20260809 23:19:21.271309 7974 leader_election.cc:302] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbb0d8f0789e4cc9a71057214cb4896e; no voters:
I20260809 23:19:21.271490 7974 leader_election.cc:288] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:19:21.271561 7977 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:21.271781 7977 raft_consensus.cc:686] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [term 1 LEADER]: Becoming Leader. State: Replica: dbb0d8f0789e4cc9a71057214cb4896e, State: Running, Role: LEADER
I20260809 23:19:21.271791 7974 sys_catalog.cc:564] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:21.271926 7977 consensus_queue.cc:237] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbb0d8f0789e4cc9a71057214cb4896e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41725 } }
I20260809 23:19:21.272318 7980 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [sys.catalog]: SysCatalogTable state changed. Reason: New leader dbb0d8f0789e4cc9a71057214cb4896e. Latest consensus state: current_term: 1 leader_uuid: "dbb0d8f0789e4cc9a71057214cb4896e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbb0d8f0789e4cc9a71057214cb4896e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41725 } } }
I20260809 23:19:21.272456 7978 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dbb0d8f0789e4cc9a71057214cb4896e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbb0d8f0789e4cc9a71057214cb4896e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 41725 } } }
I20260809 23:19:21.272553 7978 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:21.272461 7980 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:21.272919 7988 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:19:21.273094 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 7896
I20260809 23:19:21.273208 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:19:21.273383 7988 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:19:21.273398 1966 external_mini_cluster.cc:1428] Setting key 5efe5699e611f1aeda4d9b98e9dd858e
I20260809 23:19:21.275023 7988 catalog_manager.cc:1347] Generated new cluster ID: d8cad56aa2c14edb951653f31d4d0fa3
I20260809 23:19:21.275074 7988 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:19:21.279187 7999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:21.273860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55294 (local address 127.1.235.190:41725)
0809 23:19:21.274060 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:21.274069 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:21.274212 (+ 143us) server_negotiation.cc:407] Connection header received
0809 23:19:21.274322 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:21.274328 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:21.274387 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:21.274506 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:21.274743 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.275997 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.277039 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.277653 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.277785 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:21.278510 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:21.278515 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:21.278515 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:19:21.278724 (+ 209us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:21.278766 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:19:21.278780 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:21.278862 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:21.278925 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 23:19:21.279002 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":91,"threads_started":1}
I20260809 23:19:21.280138 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:19:21.285666 7988 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:19:21.286202 7988 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:19:21.294076 7988 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dbb0d8f0789e4cc9a71057214cb4896e: Generated new TSK 0
I20260809 23:19:21.294238 7988 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:19:21.301939 7999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:21.298641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55306 (local address 127.1.235.190:41725)
0809 23:19:21.298678 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:21.298680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:21.298807 (+ 127us) server_negotiation.cc:407] Connection header received
0809 23:19:21.298845 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:21.298845 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:21.298854 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:21.298905 (+ 51us) server_negotiation.cc:226] Negotiated authn=JWT
0809 23:19:21.299028 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.299442 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.300460 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.300670 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.300720 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:21.300898 (+ 178us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 23:19:21.301730 (+ 832us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36327/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 23:19:21.301874 (+ 144us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55306: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36327/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":18}
W20260809 23:19:21.301985 7999 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55306: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36327/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 23:19:21.302121 8008 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:19:21.298585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:41725 (local address 127.0.0.1:55306)
0809 23:19:21.298726 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:21.298736 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:21.298796 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:21.298922 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:21.298923 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:21.298925 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0809 23:19:21.298974 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:21.298976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.299509 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.299510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:21.300380 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:21.300383 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.300745 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.300746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:21.300805 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:21.300811 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 23:19:21.301844 (+ 1033us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36327/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 23:19:21.301933 (+ 89us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.235.190:41725: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36327/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
I20260809 23:19:21.302315 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 7896
E20260809 23:19:21.316597 8009 webserver.cc:533] Webserver: sslize failed:
E20260809 23:19:21.316702 8009 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-09T23:19:21Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (201 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T23:19:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:19:21Z Disabled control of system clock
I20260809 23:19:21.355959 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:34103
--webserver_interface=127.1.235.190
--webserver_port=0
--builtin_ntp_servers=127.1.235.148:43229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:34103
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/testchainca.cert with env {}
W20260809 23:19:21.432682 8013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:21.432893 8013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:21.432914 8013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:21.433949 8013 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:21.433980 8013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:21.433993 8013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:21.434005 8013 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:21.434016 8013 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 23:19:21.434028 8013 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 23:19:21.434044 8013 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 23:19:21.435357 8013 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:43229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:34103
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:34103
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:21.435539 8013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:21.435693 8013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:21.440407 8020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:21.440433 8022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:21.440424 8019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:21.440663 8013 server_base.cc:1034] running on GCE node
I20260809 23:19:21.440881 8013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:21.441206 8013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:21.442345 8013 hybrid_clock.cc:648] HybridClock initialized: now 1786317561442333 us; error 26 us; skew 500 ppm
I20260809 23:19:21.443598 8013 webserver.cc:460] Webserver started at http://127.1.235.190:34775/ using document root <none> and password file <none>
I20260809 23:19:21.443828 8013 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:21.443876 8013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:21.444028 8013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:21.445029 8013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "f8e24cefbcac4c4883f4a86365c23ac5"
format_stamp: "Formatted at 2026-08-09 23:19:21 on dist-test-slave-6nmv"
server_key: "093fe83b8ce22e4150ae67624aebb981"
server_key_iv: "1169b3648698cc17a4b06cb5898cc4fe"
server_key_version: "encryptionkey@0"
I20260809 23:19:21.445382 8013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "f8e24cefbcac4c4883f4a86365c23ac5"
format_stamp: "Formatted at 2026-08-09 23:19:21 on dist-test-slave-6nmv"
server_key: "093fe83b8ce22e4150ae67624aebb981"
server_key_iv: "1169b3648698cc17a4b06cb5898cc4fe"
server_key_version: "encryptionkey@0"
I20260809 23:19:21.446684 8013 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:19:21.447376 8028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:21.447554 8013 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:19:21.447654 8013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "f8e24cefbcac4c4883f4a86365c23ac5"
format_stamp: "Formatted at 2026-08-09 23:19:21 on dist-test-slave-6nmv"
server_key: "093fe83b8ce22e4150ae67624aebb981"
server_key_iv: "1169b3648698cc17a4b06cb5898cc4fe"
server_key_version: "encryptionkey@0"
I20260809 23:19:21.447731 8013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:21.483625 8013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:21.483945 8013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:21.484125 8013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:21.488040 8013 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:34103
I20260809 23:19:21.488085 8085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:34103 every 8 connection(s)
I20260809 23:19:21.488418 8013 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:19:21.489311 8086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:21.490634 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 8013
I20260809 23:19:21.490767 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:19:21.490972 1966 external_mini_cluster.cc:1428] Setting key 2315c211a6c8046b7a844d4860c193ab
I20260809 23:19:21.492185 8086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5: Bootstrap starting.
I20260809 23:19:21.492894 8086 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:21.493167 8086 log.cc:824] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:21.493903 8086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5: No bootstrap required, opened a new log
I20260809 23:19:21.496316 8086 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8e24cefbcac4c4883f4a86365c23ac5" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34103 } }
I20260809 23:19:21.496487 8089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:21.491513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44348 (local address 127.1.235.190:34103)
0809 23:19:21.491744 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:21.491752 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:21.491776 (+ 24us) server_negotiation.cc:407] Connection header received
0809 23:19:21.492159 (+ 383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:21.492165 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:21.492220 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:21.492370 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:21.492597 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.493540 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.494553 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.494969 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.495055 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:21.495768 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:21.495772 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:21.495772 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:19:21.495942 (+ 170us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:21.495980 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:19:21.495989 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:21.496051 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:21.496169 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 23:19:21.496249 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":110,"threads_started":1}
I20260809 23:19:21.496508 8086 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:21.496647 8086 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8e24cefbcac4c4883f4a86365c23ac5, State: Initialized, Role: FOLLOWER
I20260809 23:19:21.496796 8086 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8e24cefbcac4c4883f4a86365c23ac5" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34103 } }
I20260809 23:19:21.496871 8086 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:19:21.496920 8086 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:19:21.496966 8086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:21.497452 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:19:21.497606 8086 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8e24cefbcac4c4883f4a86365c23ac5" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34103 } }
I20260809 23:19:21.497699 8086 leader_election.cc:302] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8e24cefbcac4c4883f4a86365c23ac5; no voters:
I20260809 23:19:21.497867 8086 leader_election.cc:288] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:19:21.497892 8091 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:21.498032 8091 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [term 1 LEADER]: Becoming Leader. State: Replica: f8e24cefbcac4c4883f4a86365c23ac5, State: Running, Role: LEADER
I20260809 23:19:21.498114 8086 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:21.498131 8091 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8e24cefbcac4c4883f4a86365c23ac5" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34103 } }
I20260809 23:19:21.498394 8091 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8e24cefbcac4c4883f4a86365c23ac5. Latest consensus state: current_term: 1 leader_uuid: "f8e24cefbcac4c4883f4a86365c23ac5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8e24cefbcac4c4883f4a86365c23ac5" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34103 } } }
I20260809 23:19:21.498477 8091 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:21.498404 8095 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8e24cefbcac4c4883f4a86365c23ac5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8e24cefbcac4c4883f4a86365c23ac5" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34103 } } }
I20260809 23:19:21.498600 8095 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:21.499356 8099 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:19:21.499845 8099 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:19:21.501334 8099 catalog_manager.cc:1347] Generated new cluster ID: ac9a2e37f3bf44ea9959da0ae4d1d68d
I20260809 23:19:21.501394 8099 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:19:21.511304 8099 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:19:21.511806 8099 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:19:21.515503 8099 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8e24cefbcac4c4883f4a86365c23ac5: Generated new TSK 0
I20260809 23:19:21.515658 8099 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:19:21.636621 8089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:21.521727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44350 (local address 127.1.235.190:34103)
0809 23:19:21.521791 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:21.521793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:21.521923 (+ 130us) server_negotiation.cc:407] Connection header received
0809 23:19:21.521996 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:21.521997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:21.522008 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:21.522063 (+ 55us) server_negotiation.cc:226] Negotiated authn=JWT
0809 23:19:21.522206 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.522682 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.523437 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.523630 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.523700 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:21.523858 (+ 158us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 23:19:21.636342 (+112484us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 23:19:21.636524 (+ 182us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44350: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":41}
W20260809 23:19:21.636701 8089 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44350: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 23:19:21.636710 8119 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:19:21.521669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:34103 (local address 127.0.0.1:44350)
0809 23:19:21.521852 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:21.521861 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:21.521938 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:21.522071 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:21.522072 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:21.522073 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0809 23:19:21.522131 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:21.522132 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.522771 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.522772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:21.523355 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:21.523357 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:21.523704 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:21.523705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:21.523760 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:21.523764 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 23:19:21.636478 (+112714us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 23:19:21.636600 (+ 122us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.1.235.190:34103: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":94,"threads_started":1}
I20260809 23:19:21.637219 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 8013
2026-08-09T23:19:21Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (308 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (88 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (83 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:19:21 dist-test-slave-6nmv krb5kdc[8132](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:19:21 dist-test-slave-6nmv krb5kdc[8132](info): set up 2 sockets
Aug 09 23:19:21 dist-test-slave-6nmv krb5kdc[8132](info): commencing operation
krb5kdc: starting...
W20260809 23:19:22.840586 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.010s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:19:22 dist-test-slave-6nmv krb5kdc[8132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:19:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:19:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:19:22.948184 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:34337
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:42141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:34337
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:23.023461 8145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:23.023671 8145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:23.023705 8145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:23.024734 8145 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:23.024789 8145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:23.024811 8145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:23.024828 8145 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:23.024852 8145 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:19:23.026120 8145 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:42141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:34337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:34337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:23.026369 8145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:23.026599 8145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:23.031186 8153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:23.031174 8154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:23.031343 8145 server_base.cc:1034] running on GCE node
W20260809 23:19:23.031186 8156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:23.031716 8145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:23.031948 8145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:23.033135 8145 hybrid_clock.cc:648] HybridClock initialized: now 1786317563033112 us; error 52 us; skew 500 ppm
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317563, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:23.035655 8145 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:19:23.036044 8145 webserver.cc:460] Webserver started at http://127.1.235.190:42693/ using document root <none> and password file <none>
I20260809 23:19:23.036286 8145 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:23.036350 8145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:23.036489 8145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:23.037536 8145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "75275a24140642c88381c88ade5cee44"
format_stamp: "Formatted at 2026-08-09 23:19:23 on dist-test-slave-6nmv"
server_key: "fec8cf53271fdb40e7feaad619fa4236"
server_key_iv: "5eb88331e8b4899c24a5dffca2b14d5b"
server_key_version: "encryptionkey@0"
I20260809 23:19:23.037963 8145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "75275a24140642c88381c88ade5cee44"
format_stamp: "Formatted at 2026-08-09 23:19:23 on dist-test-slave-6nmv"
server_key: "fec8cf53271fdb40e7feaad619fa4236"
server_key_iv: "5eb88331e8b4899c24a5dffca2b14d5b"
server_key_version: "encryptionkey@0"
I20260809 23:19:23.039309 8145 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:19:23.040007 8163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:23.040181 8145 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:19:23.040285 8145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "75275a24140642c88381c88ade5cee44"
format_stamp: "Formatted at 2026-08-09 23:19:23 on dist-test-slave-6nmv"
server_key: "fec8cf53271fdb40e7feaad619fa4236"
server_key_iv: "5eb88331e8b4899c24a5dffca2b14d5b"
server_key_version: "encryptionkey@0"
I20260809 23:19:23.040387 8145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:23.052683 8145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:23.055009 8145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:23.055197 8145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:23.059398 8145 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:34337
I20260809 23:19:23.059473 8218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:34337 every 8 connection(s)
I20260809 23:19:23.059793 8145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:19:23.060599 8220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:23.062251 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 8145
I20260809 23:19:23.062355 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:19:23.062583 1966 external_mini_cluster.cc:1428] Setting key d4e2e5790d35f16acdd480fc33d0681c
I20260809 23:19:23.063356 8220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44: Bootstrap starting.
I20260809 23:19:23.063920 8220 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:23.064216 8220 log.cc:824] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:23.064913 8220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44: No bootstrap required, opened a new log
I20260809 23:19:23.066753 8220 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75275a24140642c88381c88ade5cee44" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34337 } }
I20260809 23:19:23.066908 8220 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:23.066972 8220 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75275a24140642c88381c88ade5cee44, State: Initialized, Role: FOLLOWER
I20260809 23:19:23.067137 8220 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75275a24140642c88381c88ade5cee44" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34337 } }
I20260809 23:19:23.067232 8220 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:19:23.067278 8220 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:19:23.067338 8220 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:23.067909 8220 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75275a24140642c88381c88ade5cee44" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34337 } }
I20260809 23:19:23.067996 8220 leader_election.cc:302] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75275a24140642c88381c88ade5cee44; no voters:
I20260809 23:19:23.068190 8220 leader_election.cc:288] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:19:23.068213 8226 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:23.068327 8226 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [term 1 LEADER]: Becoming Leader. State: Replica: 75275a24140642c88381c88ade5cee44, State: Running, Role: LEADER
I20260809 23:19:23.068457 8226 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75275a24140642c88381c88ade5cee44" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34337 } }
I20260809 23:19:23.068444 8220 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:23.068917 8228 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75275a24140642c88381c88ade5cee44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75275a24140642c88381c88ade5cee44" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34337 } } }
I20260809 23:19:23.068925 8227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75275a24140642c88381c88ade5cee44. Latest consensus state: current_term: 1 leader_uuid: "75275a24140642c88381c88ade5cee44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75275a24140642c88381c88ade5cee44" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34337 } } }
I20260809 23:19:23.069008 8228 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:23.069028 8227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44 [sys.catalog]: This master's current role is: LEADER
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317562, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:23.069963 8235 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:19:23.070657 8235 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:19:23.072319 8235 catalog_manager.cc:1347] Generated new cluster ID: 8bf5dd5d1b1f45b1983eea4391344784
I20260809 23:19:23.072369 8235 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:19:23.073756 8224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:23.063117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53066 (local address 127.1.235.190:34337)
0809 23:19:23.063303 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:23.063315 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:23.063346 (+ 31us) server_negotiation.cc:407] Connection header received
0809 23:19:23.063790 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:23.063797 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:23.063850 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:23.063998 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:23.064723 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.065663 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.066463 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.066870 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.066990 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:23.069902 (+ 2912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:23.069906 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:23.069907 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:23.069919 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:23.072111 (+ 2192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:23.072523 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:23.072526 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:23.072526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:23.072631 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:23.072870 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:23.072871 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:23.072872 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:23.073148 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:23.073278 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:23.073415 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 23:19:23.073540 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":81,"threads_started":1}
I20260809 23:19:23.089254 8235 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:19:23.089775 8235 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:19:23.095588 8235 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75275a24140642c88381c88ade5cee44: Generated new TSK 0
I20260809 23:19:23.095747 8235 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:19:23.120227 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:34337
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:42141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:23.197739 8252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:23.198004 8252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:23.198041 8252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:23.199209 8252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:23.199278 8252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:23.199323 8252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:19:23.200800 8252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:42141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:34337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:23.201071 8252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:23.201297 8252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:23.205906 8261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:23.205905 8258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:23.206049 8259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:23.206077 8252 server_base.cc:1034] running on GCE node
I20260809 23:19:23.206286 8252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:23.206521 8252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:23.207680 8252 hybrid_clock.cc:648] HybridClock initialized: now 1786317563207673 us; error 37 us; skew 500 ppm
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317563, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:23.210083 8252 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:19:23.210541 8252 webserver.cc:460] Webserver started at http://127.1.235.129:42445/ using document root <none> and password file <none>
I20260809 23:19:23.210737 8252 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:23.210778 8252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:23.210865 8252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:23.211809 8252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "19ebd0fabe234666a19e3dfa843319bb"
format_stamp: "Formatted at 2026-08-09 23:19:23 on dist-test-slave-6nmv"
server_key: "426ab3957bc988bcc0971b6f1062f5b2"
server_key_iv: "a3e7c0435c1dc8ec553e038643d580e6"
server_key_version: "encryptionkey@0"
I20260809 23:19:23.212103 8252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "19ebd0fabe234666a19e3dfa843319bb"
format_stamp: "Formatted at 2026-08-09 23:19:23 on dist-test-slave-6nmv"
server_key: "426ab3957bc988bcc0971b6f1062f5b2"
server_key_iv: "a3e7c0435c1dc8ec553e038643d580e6"
server_key_version: "encryptionkey@0"
I20260809 23:19:23.213310 8252 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:19:23.213994 8268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:23.214152 8252 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:23.214251 8252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "19ebd0fabe234666a19e3dfa843319bb"
format_stamp: "Formatted at 2026-08-09 23:19:23 on dist-test-slave-6nmv"
server_key: "426ab3957bc988bcc0971b6f1062f5b2"
server_key_iv: "a3e7c0435c1dc8ec553e038643d580e6"
server_key_version: "encryptionkey@0"
I20260809 23:19:23.214305 8252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:23.230310 8252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:23.232089 8252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:23.232195 8252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:23.232360 8252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:23.232679 8252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:23.232713 8252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:23.232734 8252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:23.232792 8252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:23.238260 8252 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:37077
I20260809 23:19:23.238337 8398 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:37077 every 8 connection(s)
I20260809 23:19:23.238636 8252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317563, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:23.245074 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 8252
I20260809 23:19:23.245190 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:19:23.245373 1966 external_mini_cluster.cc:1428] Setting key 684099bf51e3a296eabd31453a48df98
I20260809 23:19:23.247660 8224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:23.239374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:55645 (local address 127.1.235.190:34337)
0809 23:19:23.239433 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:23.239435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:23.239600 (+ 165us) server_negotiation.cc:407] Connection header received
0809 23:19:23.240464 (+ 864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:23.240465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:23.240475 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:23.240537 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:23.241076 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.241580 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.242540 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.242760 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.242812 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:23.244969 (+ 2157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:23.244970 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:23.244970 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:23.244976 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:23.246439 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:23.246864 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:23.246865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:23.246865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:23.246909 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:23.247144 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:23.247144 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:23.247144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:23.247228 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:23.247271 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:23.247535 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 23:19:23.247587 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 23:19:23.247912 8401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:23.239330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:34337 (local address 127.1.235.129:55645)
0809 23:19:23.239478 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:23.239515 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:23.240376 (+ 861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:23.240598 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:23.240601 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:23.240830 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:23.241005 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:23.241009 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.241652 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.241653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:23.242447 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:23.242449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.242833 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.242833 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:23.242964 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:23.243471 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:23.243478 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:23.244858 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:23.246508 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:23.246514 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:23.246516 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:23.246798 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:23.246961 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:23.246962 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:23.246962 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:23.247091 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:23.247284 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:23.247289 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:23.247424 (+ 135us) client_negotiation.cc:769] Sending connection context
0809 23:19:23.247519 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 23:19:23.247680 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260809 23:19:23.248387 8399 heartbeater.cc:347] Connected to a master server at 127.1.235.190:34337
I20260809 23:19:23.248466 8399 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:23.248633 8399 heartbeater.cc:511] Master 127.1.235.190:34337 requested a full tablet report, sending...
I20260809 23:19:23.249136 8180 ts_manager.cc:194] Registered new tserver with Master: 19ebd0fabe234666a19e3dfa843319bb (127.1.235.129:37077)
I20260809 23:19:23.249727 8180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:55645
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:19:23.269629 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:34337
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:42141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:23.346797 8404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:23.347034 8404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:23.347072 8404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:23.348184 8404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:23.348254 8404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:23.348301 8404 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:19:23.349733 8404 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:42141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:34337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:23.350010 8404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:23.350238 8404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:23.355537 8412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:23.355543 8410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:23.355566 8409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:23.355847 8404 server_base.cc:1034] running on GCE node
I20260809 23:19:23.356099 8404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:23.356348 8404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:23.357586 8404 hybrid_clock.cc:648] HybridClock initialized: now 1786317563357557 us; error 35 us; skew 500 ppm
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317563, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:23.360160 8404 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:19:23.360618 8404 webserver.cc:460] Webserver started at http://127.1.235.130:44023/ using document root <none> and password file <none>
I20260809 23:19:23.360837 8404 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:23.360901 8404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:23.361042 8404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:23.362103 8404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "d724ec9b43bf4ddb9dc4dd09050fdad1"
format_stamp: "Formatted at 2026-08-09 23:19:23 on dist-test-slave-6nmv"
server_key: "2f2dfde2340e73e7ecf2b498fe24b132"
server_key_iv: "f052cda1e5ea0f7e8bda347197a0f482"
server_key_version: "encryptionkey@0"
I20260809 23:19:23.362442 8404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "d724ec9b43bf4ddb9dc4dd09050fdad1"
format_stamp: "Formatted at 2026-08-09 23:19:23 on dist-test-slave-6nmv"
server_key: "2f2dfde2340e73e7ecf2b498fe24b132"
server_key_iv: "f052cda1e5ea0f7e8bda347197a0f482"
server_key_version: "encryptionkey@0"
I20260809 23:19:23.363727 8404 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260809 23:19:23.364352 8420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:23.364506 8404 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:23.364594 8404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "d724ec9b43bf4ddb9dc4dd09050fdad1"
format_stamp: "Formatted at 2026-08-09 23:19:23 on dist-test-slave-6nmv"
server_key: "2f2dfde2340e73e7ecf2b498fe24b132"
server_key_iv: "f052cda1e5ea0f7e8bda347197a0f482"
server_key_version: "encryptionkey@0"
I20260809 23:19:23.364665 8404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:23.387791 8404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:23.389577 8404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:23.389722 8404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:23.389955 8404 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:23.390244 8404 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:23.390292 8404 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:23.390332 8404 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:23.390374 8404 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:23.395854 8404 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:40299
I20260809 23:19:23.395901 8546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:40299 every 8 connection(s)
I20260809 23:19:23.396162 8404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317563, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:23.404160 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 8404
I20260809 23:19:23.404253 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:19:23.404456 1966 external_mini_cluster.cc:1428] Setting key 0507d7c81e2459cdc6d89eb2d40e9b18
I20260809 23:19:23.404480 8224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:23.396770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:44363 (local address 127.1.235.190:34337)
0809 23:19:23.396827 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:23.396829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:23.397019 (+ 190us) server_negotiation.cc:407] Connection header received
0809 23:19:23.397911 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:23.397913 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:23.397922 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:23.397974 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:23.398484 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.398983 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.399831 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.400001 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.400053 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:23.402080 (+ 2027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:23.402081 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:23.402081 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:23.402088 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:23.403298 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:23.403638 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:23.403639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:23.403639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:23.403686 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:23.403867 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:23.403867 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:23.403868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:23.403969 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:23.404015 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:23.404358 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 23:19:23.404424 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 23:19:23.404668 8549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:23.396725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:34337 (local address 127.1.235.130:44363)
0809 23:19:23.396881 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:23.396917 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:23.397762 (+ 845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:23.398023 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:23.398026 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:23.398257 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:23.398420 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:23.398423 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.399049 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.399050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:23.399760 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:23.399762 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.400069 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.400070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:23.400161 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:23.400636 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:23.400643 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:23.401989 (+ 1346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:23.403366 (+ 1377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:23.403371 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:23.403373 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:23.403579 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:23.403737 (+ 158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:23.403737 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:23.403738 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:23.403821 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:23.404030 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:23.404036 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:23.404185 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 23:19:23.404328 (+ 143us) client_negotiation.cc:240] Negotiation successful
0809 23:19:23.404480 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":87,"threads_started":1}
I20260809 23:19:23.405218 8547 heartbeater.cc:347] Connected to a master server at 127.1.235.190:34337
I20260809 23:19:23.405310 8547 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:23.405470 8547 heartbeater.cc:511] Master 127.1.235.190:34337 requested a full tablet report, sending...
I20260809 23:19:23.405800 8180 ts_manager.cc:194] Registered new tserver with Master: d724ec9b43bf4ddb9dc4dd09050fdad1 (127.1.235.130:40299)
I20260809 23:19:23.406170 8180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:44363
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:19:23.426756 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:34337
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:42141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:23.504727 8552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:23.504959 8552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:23.504993 8552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:23.506029 8552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:23.506088 8552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:23.506129 8552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:19:23.507449 8552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:42141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:34337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:23.507727 8552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:23.507948 8552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:23.512743 8563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:23.512723 8560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:23.512722 8559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:23.512853 8552 server_base.cc:1034] running on GCE node
I20260809 23:19:23.513231 8552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:23.513463 8552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:23.514636 8552 hybrid_clock.cc:648] HybridClock initialized: now 1786317563514624 us; error 43 us; skew 500 ppm
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317563, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:23.516983 8552 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:19:23.517426 8552 webserver.cc:460] Webserver started at http://127.1.235.131:34831/ using document root <none> and password file <none>
I20260809 23:19:23.517655 8552 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:23.517719 8552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:23.517865 8552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:23.518884 8552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "884e99ac85d442e7ac2a64a62d801858"
format_stamp: "Formatted at 2026-08-09 23:19:23 on dist-test-slave-6nmv"
server_key: "1f87dabadf37c63b525ef4326a847797"
server_key_iv: "5fcdd08e86d41a7c7d4bc3b386fa55a3"
server_key_version: "encryptionkey@0"
I20260809 23:19:23.519233 8552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "884e99ac85d442e7ac2a64a62d801858"
format_stamp: "Formatted at 2026-08-09 23:19:23 on dist-test-slave-6nmv"
server_key: "1f87dabadf37c63b525ef4326a847797"
server_key_iv: "5fcdd08e86d41a7c7d4bc3b386fa55a3"
server_key_version: "encryptionkey@0"
I20260809 23:19:23.520478 8552 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:19:23.521219 8570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:23.521385 8552 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:23.521486 8552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "884e99ac85d442e7ac2a64a62d801858"
format_stamp: "Formatted at 2026-08-09 23:19:23 on dist-test-slave-6nmv"
server_key: "1f87dabadf37c63b525ef4326a847797"
server_key_iv: "5fcdd08e86d41a7c7d4bc3b386fa55a3"
server_key_version: "encryptionkey@0"
I20260809 23:19:23.521575 8552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:23.541249 8552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:23.543200 8552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:23.543362 8552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:23.543584 8552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:23.543890 8552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:23.543942 8552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:23.543973 8552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:23.543999 8552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:23.549731 8552 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:35589
I20260809 23:19:23.549779 8694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:35589 every 8 connection(s)
I20260809 23:19:23.550081 8552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:19:23.551298 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 8552
I20260809 23:19:23.551401 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:19:23.551635 1966 external_mini_cluster.cc:1428] Setting key 35adf090f51dec117874de1840ae5dbd
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317563, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:19:23.559062 8224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:23.550807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:33787 (local address 127.1.235.190:34337)
0809 23:19:23.550853 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:23.550856 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:23.551068 (+ 212us) server_negotiation.cc:407] Connection header received
0809 23:19:23.552389 (+ 1321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:23.552390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:23.552404 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:23.552463 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:23.553139 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.553603 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.554531 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.554707 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.554755 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:23.556750 (+ 1995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:23.556752 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:23.556752 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:23.556757 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:23.557990 (+ 1233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:23.558332 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:23.558333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:23.558333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:23.558384 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:23.558582 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:23.558583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:23.558583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:23.558682 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:23.558732 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:23.558944 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 23:19:23.559000 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:19:23.559223 8697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:23.550792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:34337 (local address 127.1.235.131:33787)
0809 23:19:23.550953 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:23.550986 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:23.552288 (+ 1302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:23.552515 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:23.552519 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:23.552884 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:23.553053 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:23.553057 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.553690 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.553691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:23.554464 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:23.554466 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.554772 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.554773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:23.554865 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:23.555325 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:23.555333 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:23.556681 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:23.558055 (+ 1374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:23.558061 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:23.558063 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:23.558269 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:23.558437 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:23.558437 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:23.558438 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:23.558530 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:23.558734 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:23.558738 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:23.558838 (+ 100us) client_negotiation.cc:769] Sending connection context
0809 23:19:23.558916 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 23:19:23.559024 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":84,"threads_started":1}
I20260809 23:19:23.559725 8695 heartbeater.cc:347] Connected to a master server at 127.1.235.190:34337
I20260809 23:19:23.559800 8695 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:23.559988 8695 heartbeater.cc:511] Master 127.1.235.190:34337 requested a full tablet report, sending...
I20260809 23:19:23.560432 8180 ts_manager.cc:194] Registered new tserver with Master: 884e99ac85d442e7ac2a64a62d801858 (127.1.235.131:35589)
I20260809 23:19:23.560796 8180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:33787
I20260809 23:19:23.563351 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/test-admin.keytab.
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:23.578104 1966 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 23:19:23.579481 8703 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:19:23.578779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39808 (local address 127.1.235.129:37077)
0809 23:19:23.578931 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:23.578935 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:23.578943 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:19:23.578964 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:23.578966 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:23.578977 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:23.579055 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:23.579387 (+ 332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39808: BlockingRecv error: recv got EOF from 127.0.0.1:39808 (error 108)
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":67,"threads_started":1}
W20260809 23:19:23.579591 1966 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/krb5cc' of type FILE
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:23.580472 1966 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:23.581362 1966 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.129@KRBTEST.COM
I20260809 23:19:23.588459 8703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:23.581904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39812 (local address 127.1.235.129:37077)
0809 23:19:23.581967 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:23.581968 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:23.581992 (+ 24us) server_negotiation.cc:407] Connection header received
0809 23:19:23.582082 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:23.582083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:23.582093 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:23.582149 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:23.582462 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.583057 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.583616 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.583943 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.583994 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:23.585956 (+ 1962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:23.585964 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:23.585964 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:23.585970 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:23.587487 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:23.587787 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:23.587789 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:23.587789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:23.587843 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:23.587984 (+ 141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:23.587985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:23.587985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:23.588091 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:23.588198 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:23.588240 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 23:19:23.588300 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260809 23:19:23.590181 8703 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:19:23.589631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39814 (local address 127.1.235.129:37077)
0809 23:19:23.589716 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:23.589718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:23.589740 (+ 22us) server_negotiation.cc:407] Connection header received
0809 23:19:23.589797 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:23.589798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:23.589806 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:23.589902 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:23.590154 (+ 252us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39814: BlockingRecv error: recv got EOF from 127.0.0.1:39814 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 23:19:23.590250 1966 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/krb5cc' of type FILE
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:23.591148 1966 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:23.591958 1966 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.129@KRBTEST.COM
I20260809 23:19:23.597685 8703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:23.592382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39818 (local address 127.1.235.129:37077)
0809 23:19:23.592420 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:23.592422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:23.592467 (+ 45us) server_negotiation.cc:407] Connection header received
0809 23:19:23.592501 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:23.592502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:23.592509 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:23.592553 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:23.592899 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.593293 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.593910 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.594079 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.594124 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:23.595881 (+ 1757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:23.595882 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:23.595882 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:23.595887 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:23.596952 (+ 1065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:23.597223 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:23.597224 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:23.597224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:23.597266 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:23.597396 (+ 130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:23.597396 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:23.597396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:23.597455 (+ 59us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:23.597505 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:23.597577 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 23:19:23.597625 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
W20260809 23:19:23.598973 8703 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:19:23.598517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39834 (local address 127.1.235.129:37077)
0809 23:19:23.598565 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:23.598567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:23.598608 (+ 41us) server_negotiation.cc:407] Connection header received
0809 23:19:23.598667 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:23.598668 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:23.598675 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:23.598714 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:23.598936 (+ 222us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39834: BlockingRecv error: recv got EOF from 127.0.0.1:39834 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260809 23:19:23.599064 1966 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786317539151495-1966-0/krb5kdc/krb5cc' of type FILE
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:23.599833 1966 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:23.600662 1966 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8132](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.129@KRBTEST.COM
I20260809 23:19:23.606652 8703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:23.601159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39842 (local address 127.1.235.129:37077)
0809 23:19:23.601200 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:23.601202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:23.601212 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:19:23.601280 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:23.601281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:23.601289 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:23.601331 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:23.601699 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.602164 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.602800 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:23.602974 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:23.603040 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:23.604616 (+ 1576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:23.604617 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:23.604618 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:23.604624 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:23.605593 (+ 969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:23.605970 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:23.605971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:23.605972 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:23.606024 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:23.606205 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:23.606205 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:23.606206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:23.606310 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:23.606397 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:23.606501 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 23:19:23.606572 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:19:23.607235 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 8252
I20260809 23:19:23.619320 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 8404
I20260809 23:19:23.627734 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 8552
I20260809 23:19:23.633131 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 8145
2026-08-09T23:19:23Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1824 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8718](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8718](info): set up 2 sockets
Aug 09 23:19:23 dist-test-slave-6nmv krb5kdc[8718](info): commencing operation
krb5kdc: starting...
W20260809 23:19:24.715773 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260809 23:19:24.846371 1966 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.130s user 0.000s sys 0.002s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260809 23:19:24.979664 1966 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.133s user 0.001s sys 0.001s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260809 23:19:25.197686 1966 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.218s user 0.001s sys 0.001s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/test-user.keytab.
W20260809 23:19:25.682297 1966 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.484s user 0.000s sys 0.002s
Aug 09 23:19:25 dist-test-slave-6nmv krb5kdc[8718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:19:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:19:25Z Disabled control of system clock
WARNING: no policy specified for oryx/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.190.keytab.
Entry for principal oryx/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.190.keytab.
W20260809 23:19:26.328527 1966 mini_kdc.cc:262] Time spent creating service keytab for oryx/127.1.235.190: real 0.625s user 0.000s sys 0.003s
I20260809 23:19:26.328900 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:44145
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.190.keytab
--principal=oryx/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:35155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:44145
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:26.406378 8735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:26.406589 8735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:26.406623 8735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:26.407671 8735 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:26.407732 8735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:26.407755 8735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:26.407785 8735 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:26.407807 8735 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:19:26.409088 8735 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:35155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:44145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.190.keytab
--principal=oryx/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:44145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:26.409333 8735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:26.409538 8735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:26.414237 8742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:26.414237 8744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:26.414471 8735 server_base.cc:1034] running on GCE node
W20260809 23:19:26.414479 8741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:26.414881 8735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:26.415280 8735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:26.416437 8735 hybrid_clock.cc:648] HybridClock initialized: now 1786317566416423 us; error 47 us; skew 500 ppm
Aug 09 23:19:26 dist-test-slave-6nmv krb5kdc[8718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317566, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:26.422070 8735 init.cc:377] Logged in from keytab as oryx/127.1.235.190@KRBTEST.COM (short username oryx)
I20260809 23:19:26.422533 8735 webserver.cc:460] Webserver started at http://127.1.235.190:37025/ using document root <none> and password file <none>
I20260809 23:19:26.422760 8735 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:26.422828 8735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:26.422981 8735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:26.424024 8735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "573e223d38144aab863d5ff5f1849722"
format_stamp: "Formatted at 2026-08-09 23:19:26 on dist-test-slave-6nmv"
server_key: "a4ffab4385e97bc1c392e0d0522aae04"
server_key_iv: "dadf4c5dc6bae2df3b08cc2539a9e97d"
server_key_version: "encryptionkey@0"
I20260809 23:19:26.424417 8735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "573e223d38144aab863d5ff5f1849722"
format_stamp: "Formatted at 2026-08-09 23:19:26 on dist-test-slave-6nmv"
server_key: "a4ffab4385e97bc1c392e0d0522aae04"
server_key_iv: "dadf4c5dc6bae2df3b08cc2539a9e97d"
server_key_version: "encryptionkey@0"
I20260809 23:19:26.425861 8735 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:19:26.426649 8752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:26.426826 8735 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:26.426923 8735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "573e223d38144aab863d5ff5f1849722"
format_stamp: "Formatted at 2026-08-09 23:19:26 on dist-test-slave-6nmv"
server_key: "a4ffab4385e97bc1c392e0d0522aae04"
server_key_iv: "dadf4c5dc6bae2df3b08cc2539a9e97d"
server_key_version: "encryptionkey@0"
I20260809 23:19:26.427007 8735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:26.436609 8735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:26.438349 8735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:26.438496 8735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:26.442570 8735 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:44145
I20260809 23:19:26.442600 8808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:44145 every 8 connection(s)
I20260809 23:19:26.442921 8735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:19:26.443843 8809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:26.444191 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 8735
I20260809 23:19:26.444307 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:19:26.444532 1966 external_mini_cluster.cc:1428] Setting key 8ed58169afc351ebe9b8cafa7800842e
I20260809 23:19:26.446960 8809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722: Bootstrap starting.
I20260809 23:19:26.447567 8809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:26.447849 8809 log.cc:824] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:26.448514 8809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722: No bootstrap required, opened a new log
I20260809 23:19:26.450559 8809 raft_consensus.cc:348] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } }
I20260809 23:19:26.450750 8809 raft_consensus.cc:374] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:26.450788 8809 raft_consensus.cc:729] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 573e223d38144aab863d5ff5f1849722, State: Initialized, Role: FOLLOWER
I20260809 23:19:26.450924 8809 consensus_queue.cc:260] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } }
I20260809 23:19:26.451015 8809 raft_consensus.cc:388] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
Aug 09 23:19:26 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM
I20260809 23:19:26.451051 8809 raft_consensus.cc:482] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:19:26.451108 8809 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:26.451823 8809 raft_consensus.cc:504] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } }
I20260809 23:19:26.451965 8809 leader_election.cc:302] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 573e223d38144aab863d5ff5f1849722; no voters:
I20260809 23:19:26.452190 8809 leader_election.cc:288] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:19:26.452237 8816 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:26.452426 8816 raft_consensus.cc:686] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [term 1 LEADER]: Becoming Leader. State: Replica: 573e223d38144aab863d5ff5f1849722, State: Running, Role: LEADER
I20260809 23:19:26.452453 8809 sys_catalog.cc:564] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:26.452560 8816 consensus_queue.cc:237] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } }
I20260809 23:19:26.452901 8816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 573e223d38144aab863d5ff5f1849722. Latest consensus state: current_term: 1 leader_uuid: "573e223d38144aab863d5ff5f1849722" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } }
I20260809 23:19:26.453146 8816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:26.453065 8817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "573e223d38144aab863d5ff5f1849722" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } }
I20260809 23:19:26.453543 8817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:26.454025 8825 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:19:26.454800 8825 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:19:26.455824 8813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:26.445012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46630 (local address 127.1.235.190:44145)
0809 23:19:26.445203 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:26.445210 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:26.445234 (+ 24us) server_negotiation.cc:407] Connection header received
0809 23:19:26.445631 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:26.445636 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:26.445684 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:26.445791 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:26.446670 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:26.447580 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:26.448446 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:26.448915 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:26.449033 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:26.451617 (+ 2584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:26.451621 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:26.451621 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:26.451632 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:26.453770 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:26.454348 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:26.454351 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:26.454351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:26.454450 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:26.454683 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:26.454684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:26.454685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:26.454973 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:26.455139 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:26.455261 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 23:19:26.455652 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":107,"threads_started":1}
I20260809 23:19:26.456411 8825 catalog_manager.cc:1347] Generated new cluster ID: e910e5b17cb44a04990f05798ec75788
I20260809 23:19:26.456460 8825 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:19:26.491513 8825 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:19:26.492291 8825 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:19:26.500015 8825 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722: Generated new TSK 0
I20260809 23:19:26.500181 8825 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.129.keytab.
Entry for principal oryx/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.129.keytab.
I20260809 23:19:26.526707 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:44145
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.129.keytab
--principal=oryx/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:35155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:26.606446 8839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:26.606686 8839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:26.606724 8839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:26.608124 8839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:26.608174 8839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:26.608214 8839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:19:26.610431 8839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:35155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.129.keytab
--principal=oryx/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:44145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:26.610683 8839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:26.610937 8839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:26.615733 8847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:26.615739 8844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:26.615742 8845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:26.615852 8839 server_base.cc:1034] running on GCE node
I20260809 23:19:26.616108 8839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:26.616345 8839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:26.617509 8839 hybrid_clock.cc:648] HybridClock initialized: now 1786317566617502 us; error 37 us; skew 500 ppm
Aug 09 23:19:26 dist-test-slave-6nmv krb5kdc[8718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317566, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:26.620064 8839 init.cc:377] Logged in from keytab as oryx/127.1.235.129@KRBTEST.COM (short username oryx)
I20260809 23:19:26.620513 8839 webserver.cc:460] Webserver started at http://127.1.235.129:34365/ using document root <none> and password file <none>
I20260809 23:19:26.620775 8839 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:26.620843 8839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:26.620985 8839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:26.622030 8839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "bf963feece204c379c42d6add1d14363"
format_stamp: "Formatted at 2026-08-09 23:19:26 on dist-test-slave-6nmv"
server_key: "8176f04518c11c72386bb1526f2957ed"
server_key_iv: "0f8a34ea5724b63701561631db6919a5"
server_key_version: "encryptionkey@0"
I20260809 23:19:26.622313 8839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "bf963feece204c379c42d6add1d14363"
format_stamp: "Formatted at 2026-08-09 23:19:26 on dist-test-slave-6nmv"
server_key: "8176f04518c11c72386bb1526f2957ed"
server_key_iv: "0f8a34ea5724b63701561631db6919a5"
server_key_version: "encryptionkey@0"
I20260809 23:19:26.623492 8839 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:26.624083 8856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:26.624269 8839 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:26.624352 8839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "bf963feece204c379c42d6add1d14363"
format_stamp: "Formatted at 2026-08-09 23:19:26 on dist-test-slave-6nmv"
server_key: "8176f04518c11c72386bb1526f2957ed"
server_key_iv: "0f8a34ea5724b63701561631db6919a5"
server_key_version: "encryptionkey@0"
I20260809 23:19:26.624402 8839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:26.639386 8839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:26.641191 8839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:26.641299 8839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:26.641465 8839 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:26.641762 8839 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:26.641806 8839 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:26.641896 8839 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:26.641935 8839 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:26.647425 8839 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:32795
I20260809 23:19:26.647481 8988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:32795 every 8 connection(s)
I20260809 23:19:26.647744 8839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:19:26.651379 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 8839
I20260809 23:19:26.651504 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:19:26.651754 1966 external_mini_cluster.cc:1428] Setting key ab5cda6f32eb365812419b7845037dc7
Aug 09 23:19:26 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317566, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM
I20260809 23:19:26.657374 8813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:26.648410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:44155 (local address 127.1.235.190:44145)
0809 23:19:26.648457 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:26.648459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:26.648672 (+ 213us) server_negotiation.cc:407] Connection header received
0809 23:19:26.649133 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:26.649133 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:26.649142 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:26.649197 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:26.650131 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:26.650605 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:26.651621 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:26.651944 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:26.652038 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:26.654549 (+ 2511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:26.654551 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:26.654551 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:26.654559 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:26.655987 (+ 1428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:26.656399 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:26.656400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:26.656401 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:26.656463 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:26.656717 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:26.656718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:26.656719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:26.656837 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:26.656904 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:26.657195 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 23:19:26.657292 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 23:19:26.657526 8991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:26.648381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:44155)
0809 23:19:26.648551 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:26.648592 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:26.649049 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:26.649265 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:26.649268 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:26.649818 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:26.650053 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:26.650058 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:26.650707 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:26.650708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:26.651473 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:26.651474 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:26.652107 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:26.652108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:26.652243 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:26.652854 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:26.652861 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:26.654454 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:26.656095 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:26.656102 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:26.656104 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:26.656321 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:26.656531 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:26.656532 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:26.656532 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:26.656644 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:26.656909 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:26.656915 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:26.657040 (+ 125us) client_negotiation.cc:769] Sending connection context
0809 23:19:26.657161 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 23:19:26.657318 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":97,"threads_started":1}
I20260809 23:19:26.658015 8989 heartbeater.cc:347] Connected to a master server at 127.1.235.190:44145
I20260809 23:19:26.658108 8989 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:26.658294 8989 heartbeater.cc:511] Master 127.1.235.190:44145 requested a full tablet report, sending...
I20260809 23:19:26.658882 8769 ts_manager.cc:194] Registered new tserver with Master: bf963feece204c379c42d6add1d14363 (127.1.235.129:32795)
I20260809 23:19:26.659850 8769 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:44155
WARNING: no policy specified for oryx/127.1.235.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.130.keytab.
Entry for principal oryx/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.130.keytab.
I20260809 23:19:26.675863 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:44145
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.130.keytab
--principal=oryx/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:35155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:26.753530 8994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:26.753831 8994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:26.753865 8994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:26.755273 8994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:26.755333 8994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:26.755375 8994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:19:26.757138 8994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:35155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.130.keytab
--principal=oryx/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:44145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:26.757366 8994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:26.757635 8994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:26.762398 9002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:26.762465 8994 server_base.cc:1034] running on GCE node
W20260809 23:19:26.762404 9004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:26.762427 8999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:26.762811 8994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:26.763053 8994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:26.764189 8994 hybrid_clock.cc:648] HybridClock initialized: now 1786317566764168 us; error 37 us; skew 500 ppm
Aug 09 23:19:26 dist-test-slave-6nmv krb5kdc[8718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317566, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:26.766923 8994 init.cc:377] Logged in from keytab as oryx/127.1.235.130@KRBTEST.COM (short username oryx)
I20260809 23:19:26.767338 8994 webserver.cc:460] Webserver started at http://127.1.235.130:35347/ using document root <none> and password file <none>
I20260809 23:19:26.767529 8994 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:26.767567 8994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:26.767660 8994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:26.768553 8994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "8144f47baac64d2080c8bb6e16304891"
format_stamp: "Formatted at 2026-08-09 23:19:26 on dist-test-slave-6nmv"
server_key: "927b66ea885fac8bb602292968b69fa4"
server_key_iv: "6fa1053db7fcf5e70087932dd3a28b91"
server_key_version: "encryptionkey@0"
I20260809 23:19:26.768837 8994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "8144f47baac64d2080c8bb6e16304891"
format_stamp: "Formatted at 2026-08-09 23:19:26 on dist-test-slave-6nmv"
server_key: "927b66ea885fac8bb602292968b69fa4"
server_key_iv: "6fa1053db7fcf5e70087932dd3a28b91"
server_key_version: "encryptionkey@0"
I20260809 23:19:26.770061 8994 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:19:26.770736 9011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:26.770906 8994 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:26.770982 8994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "8144f47baac64d2080c8bb6e16304891"
format_stamp: "Formatted at 2026-08-09 23:19:26 on dist-test-slave-6nmv"
server_key: "927b66ea885fac8bb602292968b69fa4"
server_key_iv: "6fa1053db7fcf5e70087932dd3a28b91"
server_key_version: "encryptionkey@0"
I20260809 23:19:26.771032 8994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:26.786036 8994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:26.787878 8994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:26.787993 8994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:26.788182 8994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:26.788421 8994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:26.788452 8994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:26.788475 8994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:26.788489 8994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:26.794667 8994 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:35349
I20260809 23:19:26.794715 9137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:35349 every 8 connection(s)
I20260809 23:19:26.795017 8994 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
Aug 09 23:19:26 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317566, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM
I20260809 23:19:26.800407 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 8994
I20260809 23:19:26.800525 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:19:26.800756 1966 external_mini_cluster.cc:1428] Setting key b8514cc0a27586a19c280303429cb58e
I20260809 23:19:26.803659 8813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:26.795712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:56621 (local address 127.1.235.190:44145)
0809 23:19:26.795781 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:26.795783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:26.795944 (+ 161us) server_negotiation.cc:407] Connection header received
0809 23:19:26.796385 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:26.796386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:26.796396 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:26.796457 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:26.797317 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:26.797789 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:26.798742 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:26.798930 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:26.798978 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:26.800959 (+ 1981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:26.800960 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:26.800961 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:26.800969 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:26.802389 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:26.802768 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:26.802769 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:26.802769 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:26.802825 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:26.803064 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:26.803065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:26.803065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:26.803169 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:26.803240 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:26.803501 (+ 261us) server_negotiation.cc:299] Negotiation successful
0809 23:19:26.803574 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 23:19:26.803828 9140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:26.795637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:56621)
0809 23:19:26.795816 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:26.795854 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:26.796286 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:26.796522 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:26.796525 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:26.797038 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:26.797209 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:26.797213 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:26.797951 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:26.797952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:26.798666 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:26.798668 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:26.799009 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:26.799010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:26.799106 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:26.799516 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:26.799523 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:26.800862 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:26.802479 (+ 1617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:26.802487 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:26.802489 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:26.802694 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:26.802897 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:26.802898 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:26.802898 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:26.803003 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:26.803232 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:26.803238 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:26.803366 (+ 128us) client_negotiation.cc:769] Sending connection context
0809 23:19:26.803478 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 23:19:26.803621 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":92,"threads_started":1}
I20260809 23:19:26.804418 9138 heartbeater.cc:347] Connected to a master server at 127.1.235.190:44145
I20260809 23:19:26.804512 9138 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:26.804666 9138 heartbeater.cc:511] Master 127.1.235.190:44145 requested a full tablet report, sending...
I20260809 23:19:26.805078 8769 ts_manager.cc:194] Registered new tserver with Master: 8144f47baac64d2080c8bb6e16304891 (127.1.235.130:35349)
I20260809 23:19:26.805529 8769 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:56621
WARNING: no policy specified for oryx/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.131.keytab.
Entry for principal oryx/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.131.keytab.
I20260809 23:19:26.824795 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:44145
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.131.keytab
--principal=oryx/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:35155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:26.913977 9144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:26.914258 9144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:26.914288 9144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:26.915704 9144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:26.915766 9144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:26.915797 9144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:19:26.917474 9144 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:35155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.131.keytab
--principal=oryx/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:44145
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:26.917738 9144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:26.918018 9144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:26.923998 9152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:26.923998 9150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:26.924016 9154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:26.924142 9144 server_base.cc:1034] running on GCE node
I20260809 23:19:26.924563 9144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:26.924818 9144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:26.926050 9144 hybrid_clock.cc:648] HybridClock initialized: now 1786317566926002 us; error 34 us; skew 500 ppm
Aug 09 23:19:26 dist-test-slave-6nmv krb5kdc[8718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317566, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:26.929466 9144 init.cc:377] Logged in from keytab as oryx/127.1.235.131@KRBTEST.COM (short username oryx)
I20260809 23:19:26.930053 9144 webserver.cc:460] Webserver started at http://127.1.235.131:40691/ using document root <none> and password file <none>
I20260809 23:19:26.930398 9144 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:26.930454 9144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:26.930559 9144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:26.931708 9144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "9be6f411651c42d39f0d15858ec42a45"
format_stamp: "Formatted at 2026-08-09 23:19:26 on dist-test-slave-6nmv"
server_key: "6f545196d8d0d9b60ae20a70f489d68f"
server_key_iv: "e189c85d6e0c6ca8a5fa37a241808dc1"
server_key_version: "encryptionkey@0"
I20260809 23:19:26.932053 9144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "9be6f411651c42d39f0d15858ec42a45"
format_stamp: "Formatted at 2026-08-09 23:19:26 on dist-test-slave-6nmv"
server_key: "6f545196d8d0d9b60ae20a70f489d68f"
server_key_iv: "e189c85d6e0c6ca8a5fa37a241808dc1"
server_key_version: "encryptionkey@0"
I20260809 23:19:26.933619 9144 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:19:26.934717 9162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:26.934924 9144 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:26.935042 9144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "9be6f411651c42d39f0d15858ec42a45"
format_stamp: "Formatted at 2026-08-09 23:19:26 on dist-test-slave-6nmv"
server_key: "6f545196d8d0d9b60ae20a70f489d68f"
server_key_iv: "e189c85d6e0c6ca8a5fa37a241808dc1"
server_key_version: "encryptionkey@0"
I20260809 23:19:26.935110 9144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:26.947355 9144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:26.950083 9144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:26.950227 9144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:26.950536 9144 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:26.950894 9144 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:26.950932 9144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:26.950977 9144 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:26.951005 9144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:26.957729 9144 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:40061
I20260809 23:19:26.957873 9289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:40061 every 8 connection(s)
I20260809 23:19:26.958249 9144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:19:26.960493 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 9144
I20260809 23:19:26.960621 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:19:26.960795 1966 external_mini_cluster.cc:1428] Setting key 457e7bbcf2faf39c20c8205adea3fca5
Aug 09 23:19:26 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317566, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM
I20260809 23:19:26.968567 8813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:26.959146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:51479 (local address 127.1.235.190:44145)
0809 23:19:26.959225 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:26.959228 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:26.959468 (+ 240us) server_negotiation.cc:407] Connection header received
0809 23:19:26.960000 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:26.960002 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:26.960014 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:26.960073 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:26.961286 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:26.962018 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:26.963048 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:26.963243 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:26.963303 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:26.965714 (+ 2411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:26.965716 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:26.965716 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:26.965725 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:26.967168 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:26.967708 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:26.967709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:26.967709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:26.967770 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:26.967993 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:26.967993 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:26.967994 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:26.968103 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:26.968151 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:26.968414 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 23:19:26.968492 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 23:19:26.968775 9292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:26.959122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:51479)
0809 23:19:26.959332 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:26.959373 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:26.959889 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:26.960148 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:26.960152 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:26.960886 (+ 734us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:26.961183 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:26.961189 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:26.962109 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:26.962109 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:26.962959 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:26.962961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:26.963330 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:26.963331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:26.963444 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:26.963987 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:26.963995 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:26.965610 (+ 1615us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:26.967267 (+ 1657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:26.967275 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:26.967277 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:26.967647 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:26.967833 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:26.967833 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:26.967834 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:26.967947 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:26.968154 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:26.968158 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:26.968293 (+ 135us) client_negotiation.cc:769] Sending connection context
0809 23:19:26.968384 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 23:19:26.968526 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":113,"threads_started":1}
I20260809 23:19:26.969452 9290 heartbeater.cc:347] Connected to a master server at 127.1.235.190:44145
I20260809 23:19:26.969590 9290 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:26.969877 9290 heartbeater.cc:511] Master 127.1.235.190:44145 requested a full tablet report, sending...
I20260809 23:19:26.970350 8769 ts_manager.cc:194] Registered new tserver with Master: 9be6f411651c42d39f0d15858ec42a45 (127.1.235.131:40061)
I20260809 23:19:26.970734 8769 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:51479
I20260809 23:19:26.972784 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.1.235.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.235.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.235.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.189.keytab.
Entry for principal oryx/127.1.235.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.189.keytab.
I20260809 23:19:27.001312 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.189:42473
--webserver_interface=127.1.235.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.189.keytab
--principal=oryx/127.1.235.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:35155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:44145,127.1.235.189:42473
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:27.092334 9296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:27.092571 9296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:27.092594 9296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:27.093782 9296 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:27.093854 9296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:27.093869 9296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:27.093883 9296 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:27.093894 9296 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:19:27.095435 9296 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:35155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:44145,127.1.235.189:42473
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.189.keytab
--principal=oryx/127.1.235.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.189:42473
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.235.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
W20260809 23:19:27.095593 9296 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.1.235.190:44145,127.1.235.189:42473'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 23:19:27.095752 9296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:27.096021 9296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:27.101308 9303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:27.101410 9307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:27.101552 9296 server_base.cc:1034] running on GCE node
W20260809 23:19:27.101327 9305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:27.101967 9296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:27.102356 9296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:27.103546 9296 hybrid_clock.cc:648] HybridClock initialized: now 1786317567103535 us; error 50 us; skew 500 ppm
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:27.106348 9296 init.cc:377] Logged in from keytab as oryx/127.1.235.189@KRBTEST.COM (short username oryx)
I20260809 23:19:27.106833 9296 webserver.cc:460] Webserver started at http://127.1.235.189:35873/ using document root <none> and password file <none>
I20260809 23:19:27.107105 9296 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:27.107180 9296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:27.107339 9296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:27.108533 9296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/data/instance:
uuid: "e138e903b8e7464eaa33982beed4f8bd"
format_stamp: "Formatted at 2026-08-09 23:19:27 on dist-test-slave-6nmv"
server_key: "d9486d92b91426103a5dff0c564e3869"
server_key_iv: "7b8957fae3bd53c0974b4883c97797af"
server_key_version: "encryptionkey@0"
I20260809 23:19:27.108922 9296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/wal/instance:
uuid: "e138e903b8e7464eaa33982beed4f8bd"
format_stamp: "Formatted at 2026-08-09 23:19:27 on dist-test-slave-6nmv"
server_key: "d9486d92b91426103a5dff0c564e3869"
server_key_iv: "7b8957fae3bd53c0974b4883c97797af"
server_key_version: "encryptionkey@0"
I20260809 23:19:27.110388 9296 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:19:27.111208 9315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.111409 9296 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:19:27.111521 9296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/wal
uuid: "e138e903b8e7464eaa33982beed4f8bd"
format_stamp: "Formatted at 2026-08-09 23:19:27 on dist-test-slave-6nmv"
server_key: "d9486d92b91426103a5dff0c564e3869"
server_key_iv: "7b8957fae3bd53c0974b4883c97797af"
server_key_version: "encryptionkey@0"
I20260809 23:19:27.111595 9296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:27.129554 9296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:27.132257 9296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:27.132426 9296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:27.136446 9296 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.189:42473
I20260809 23:19:27.136509 9373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.189:42473 every 8 connection(s)
I20260809 23:19:27.136852 9296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/data/info.pb
I20260809 23:19:27.137951 9374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:27.138053 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 9296
I20260809 23:19:27.140570 9374 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.235.189@KRBTEST.COM
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.189@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM
I20260809 23:19:27.149782 8813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.141499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46640 (local address 127.1.235.190:44145)
0809 23:19:27.141569 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.141571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.141738 (+ 167us) server_negotiation.cc:407] Connection header received
0809 23:19:27.141771 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.141772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.141783 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.141883 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.142493 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.143116 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.144149 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.144332 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.144387 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.146749 (+ 2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.146750 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.146750 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.146759 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.148232 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.148831 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.148832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.148833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.148895 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.149139 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.149140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.149140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.149307 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.149382 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.149609 (+ 227us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.149704 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 23:19:27.149994 9378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.138940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59998 (local address 127.1.235.189:42473)
0809 23:19:27.139122 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.139131 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.139165 (+ 34us) server_negotiation.cc:407] Connection header received
0809 23:19:27.139649 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.139657 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.139723 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.139852 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.140671 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.141919 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.142807 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.143389 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.143470 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.146198 (+ 2728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.146206 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.146206 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.146214 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.148116 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.148560 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.148564 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.148564 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.148660 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.148954 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.148955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.148955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.149259 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.149383 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.149536 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.149701 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":134,"thread_start_us":101,"threads_started":1}
I20260809 23:19:27.150105 9379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.141431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:46640)
0809 23:19:27.141637 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.141668 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.141727 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.141899 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.141901 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.142257 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.142340 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.142342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.143226 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.143227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.144061 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.144064 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.144421 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.144422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.144513 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.144946 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.144956 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.146654 (+ 1698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.148317 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.148322 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.148324 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.148619 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.148972 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.148973 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.148973 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.149074 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.149382 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.149388 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.149468 (+ 80us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.149562 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.149933 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":246,"thread_start_us":109,"threads_started":1}
I20260809 23:19:27.150792 9374 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.189@KRBTEST.COM for oryx/127.1.235.189@KRBTEST.COM
I20260809 23:19:27.156780 9378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.151108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60000 (local address 127.1.235.189:42473)
0809 23:19:27.151155 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.151157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.151164 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:19:27.151205 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.151206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.151213 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.151264 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.151480 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.151938 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.152612 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.152862 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.152909 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.154655 (+ 1746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.154657 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.154657 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.154663 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.155905 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.156218 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.156219 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.156219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.156267 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.156392 (+ 125us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.156393 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.156393 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.156482 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.156540 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.156645 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.156715 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":30}
I20260809 23:19:27.156898 9379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.151060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:42473 (local address 127.0.0.1:60000)
0809 23:19:27.151108 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.151119 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.151156 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.151266 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.151267 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.151378 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.151423 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.151424 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.152012 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.152013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.152542 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.152544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.152919 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.152919 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.152989 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.153340 (+ 351us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.153343 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.154578 (+ 1235us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.155980 (+ 1402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.155980 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.155981 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.156158 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.156305 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.156305 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.156306 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.156348 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.156543 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.156544 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.156578 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.156631 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.156760 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":52}
I20260809 23:19:27.158406 9374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: Bootstrap starting.
I20260809 23:19:27.159276 9374 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:27.159564 9374 log.cc:824] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:27.160318 9374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: No bootstrap required, opened a new log
I20260809 23:19:27.161741 9374 raft_consensus.cc:348] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } }
I20260809 23:19:27.161934 9374 raft_consensus.cc:374] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:27.161986 9374 raft_consensus.cc:729] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e138e903b8e7464eaa33982beed4f8bd, State: Initialized, Role: FOLLOWER
I20260809 23:19:27.162124 9374 consensus_queue.cc:260] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } }
I20260809 23:19:27.162374 9381 sys_catalog.cc:455] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } } }
I20260809 23:19:27.162418 9374 sys_catalog.cc:564] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:27.162472 9381 sys_catalog.cc:458] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [sys.catalog]: This master's current role is: FOLLOWER
W20260809 23:19:27.164251 9392 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 23:19:27.164312 9392 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:19:27.166121 9296 master_runner.cc:428] Detected that this master e138e903b8e7464eaa33982beed4f8bd is joining an existing cluster
I20260809 23:19:27.166185 9296 master_runner.cc:432] Initiating AddMaster RPC to add 127.1.235.189:42473
I20260809 23:19:27.174286 9378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.167236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60006 (local address 127.1.235.189:42473)
0809 23:19:27.167316 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.167317 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.167475 (+ 158us) server_negotiation.cc:407] Connection header received
0809 23:19:27.167560 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.167560 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.167569 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.167621 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.168169 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.168876 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.169832 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.170030 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.170100 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.171419 (+ 1319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.171421 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.171421 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.171428 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.173079 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.173459 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.173460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.173460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.173525 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.173711 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.173712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.173712 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.173855 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.173915 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.174072 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.174201 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":67,"server-negotiator.queue_time_us":60}
I20260809 23:19:27.174319 9399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.167263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:42473 (local address 127.0.0.1:60006)
0809 23:19:27.167422 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.167432 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.167494 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.167625 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.167626 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.167942 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.168046 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.168048 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.168958 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.168959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.169730 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.169732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.170144 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.170145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.170197 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.170808 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.170812 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.171331 (+ 519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.173182 (+ 1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.173183 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.173183 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.173354 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.173592 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.173593 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.173593 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.173659 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.173937 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.173937 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.173973 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.174047 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.174151 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":106,"threads_started":1}
I20260809 23:19:27.174566 8813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.167171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46652 (local address 127.1.235.190:44145)
0809 23:19:27.167281 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.167283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.167470 (+ 187us) server_negotiation.cc:407] Connection header received
0809 23:19:27.167510 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.167511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.167526 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.167599 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.168117 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.168631 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.169680 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.170010 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.170088 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.171704 (+ 1616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.171706 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.171706 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.171713 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.173326 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.173667 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.173668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.173669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.173727 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.173963 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.173963 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.173964 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.174090 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.174136 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.174355 (+ 219us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.174440 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 23:19:27.175328 9398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.167139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:46652)
0809 23:19:27.167357 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.167383 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.167455 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.167653 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.167654 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.167935 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.168031 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.168034 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.168708 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.168709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.169593 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.169595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.170107 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.170108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.170170 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.170887 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.170892 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.171329 (+ 437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.173404 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.173405 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.173406 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.173599 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.173801 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.173801 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.173802 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.173885 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.174185 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.174186 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.174237 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.175037 (+ 800us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.175196 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":92,"threads_started":1}
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317566, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.190@KRBTEST.COM for oryx/127.1.235.189@KRBTEST.COM
I20260809 23:19:27.185076 9378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.177738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60018 (local address 127.1.235.189:42473)
0809 23:19:27.177777 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.177780 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.178045 (+ 265us) server_negotiation.cc:407] Connection header received
0809 23:19:27.178131 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.178132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.178140 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.178184 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.178661 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.179230 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.180352 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.180539 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.180593 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.182673 (+ 2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.182675 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.182675 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.182682 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.183953 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.184320 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.184321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.184321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.184375 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.184571 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.184572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.184572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.184671 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.184744 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.184916 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.184991 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 23:19:27.185115 9400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.177663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:42473 (local address 127.0.0.1:60018)
0809 23:19:27.177894 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.177980 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.178057 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.178190 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.178192 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.178527 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.178585 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.178587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.179311 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.179312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.180274 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.180277 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.180617 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.180618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.180707 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.181110 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.181115 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.182591 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.184047 (+ 1456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.184054 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.184056 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.184249 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.184448 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.184449 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.184449 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.184509 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.184737 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.184744 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.184796 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.184892 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.185005 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":97,"threads_started":1}
I20260809 23:19:27.185606 8769 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.1.235.189:42473: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd"
member_type: NON_VOTER
last_known_addr {
host: "127.1.235.189"
port: 42473
}
attrs {
promote: true
}
}
dest_uuid: "573e223d38144aab863d5ff5f1849722"
cas_config_opid_index: -1
I20260809 23:19:27.186020 8769 consensus_queue.cc:237] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: NON_VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: true } }
I20260809 23:19:27.186537 9405 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER e138e903b8e7464eaa33982beed4f8bd (127.1.235.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: NON_VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: true } } }
I20260809 23:19:27.186839 9346 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:27.187605 9405 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.1.235.189:42473
I20260809 23:19:27.187605 9346 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Refusing update from remote peer 573e223d38144aab863d5ff5f1849722: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 23:19:27.187752 9405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "573e223d38144aab863d5ff5f1849722" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: NON_VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: true } } }
I20260809 23:19:27.187825 9405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:27.187922 9296 master.cc:537] Master@127.1.235.189:42473 shutting down...
I20260809 23:19:27.188272 9404 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: NON_VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 23:19:27.189028 8756 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260809 23:19:27.189433 8756 consensus_peers.cc:487] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 -> Peer e138e903b8e7464eaa33982beed4f8bd (127.1.235.189:42473): Couldn't send request to peer e138e903b8e7464eaa33982beed4f8bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 23:19:27.190701 9296 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:27.190786 9296 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:27.190836 9296 tablet_replica.cc:330] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: stopping tablet replica
I20260809 23:19:27.203442 9296 master.cc:552] Master@127.1.235.189:42473 shutdown complete.
I20260809 23:19:27.203485 9296 master_runner.cc:305] Clearing existing system tablet
I20260809 23:19:27.203624 9296 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:27.203662 9296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:27.204242 9296 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:27.204710 9409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.204809 9296 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:27.204861 9296 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.204883 9296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/wal
uuid: "e138e903b8e7464eaa33982beed4f8bd"
format_stamp: "Formatted at 2026-08-09 23:19:27 on dist-test-slave-6nmv"
server_key: "d9486d92b91426103a5dff0c564e3869"
server_key_iv: "7b8957fae3bd53c0974b4883c97797af"
server_key_version: "encryptionkey@0"
I20260809 23:19:27.205539 9296 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:27.206945 9296 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 23:19:27.207001 9296 log.cc:1196] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 23:19:27.207222 9296 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: Deleting consensus metadata
I20260809 23:19:27.207347 9296 master_runner.cc:315] Copying system tablet from 127.1.235.190:44145
I20260809 23:19:27.207901 9296 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: tablet copy: Beginning tablet copy session from remote peer at address 127.1.235.190:44145
I20260809 23:19:27.213918 8813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.208271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46666 (local address 127.1.235.190:44145)
0809 23:19:27.208318 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.208320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.208372 (+ 52us) server_negotiation.cc:407] Connection header received
0809 23:19:27.208445 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.208446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.208455 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.208525 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.208815 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.209310 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.210065 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.210267 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.210331 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.211320 (+ 989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.211322 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.211322 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.211329 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.212711 (+ 1382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.213159 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.213160 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.213160 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.213215 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.213388 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.213389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.213390 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.213493 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.213563 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.213718 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.213784 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 23:19:27.213930 9415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.208206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:46666)
0809 23:19:27.208315 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.208326 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.208387 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.208527 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.208528 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.208703 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.208742 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.208744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.209385 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.209387 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.209988 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.209990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.210329 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.210330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.210406 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.210924 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.210928 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.211235 (+ 307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.212930 (+ 1695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.212931 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.212931 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.213095 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.213273 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.213274 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.213274 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.213327 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.213565 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.213566 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.213607 (+ 41us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.213690 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.213786 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":67,"threads_started":1}
I20260809 23:19:27.214440 8793 tablet_copy_service.cc:140] P 573e223d38144aab863d5ff5f1849722: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer e138e903b8e7464eaa33982beed4f8bd ({username='oryx', principal='oryx/127.1.235.189@KRBTEST.COM'} at 127.0.0.1:46666)
I20260809 23:19:27.214553 8793 tablet_copy_service.cc:161] P 573e223d38144aab863d5ff5f1849722: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer e138e903b8e7464eaa33982beed4f8bd at {username='oryx', principal='oryx/127.1.235.189@KRBTEST.COM'} at 127.0.0.1:46666: session id = e138e903b8e7464eaa33982beed4f8bd-00000000000000000000000000000000
I20260809 23:19:27.215231 8793 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 23:19:27.215806 9296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 23:19:27.216694 9296 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: tablet copy: Starting download of 0 data blocks...
I20260809 23:19:27.216845 9296 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: tablet copy: Starting download of 1 WAL segments...
I20260809 23:19:27.217662 9296 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 23:19:27.218395 8793 tablet_copy_service.cc:342] P 573e223d38144aab863d5ff5f1849722: Request end of tablet copy session e138e903b8e7464eaa33982beed4f8bd-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.1.235.189@KRBTEST.COM'} at 127.0.0.1:46666
I20260809 23:19:27.218451 8793 tablet_copy_service.cc:433] P 573e223d38144aab863d5ff5f1849722: ending tablet copy session e138e903b8e7464eaa33982beed4f8bd-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer e138e903b8e7464eaa33982beed4f8bd
I20260809 23:19:27.220813 9296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:27.222097 9417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:27.222189 9419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:27.222205 9296 server_base.cc:1034] running on GCE node
W20260809 23:19:27.222298 9416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:27.222407 9296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:27.222558 9296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:27.223690 9296 hybrid_clock.cc:648] HybridClock initialized: now 1786317567223676 us; error 28 us; skew 500 ppm
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:27.224925 9296 init.cc:377] Logged in from keytab as oryx/127.1.235.189@KRBTEST.COM (short username oryx)
I20260809 23:19:27.225186 9296 webserver.cc:460] Webserver started at http://127.1.235.189:42305/ using document root <none> and password file <none>
I20260809 23:19:27.225304 9296 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:27.225342 9296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:27.225934 9296 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.226421 9426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.226538 9296 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.226604 9296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/wal
uuid: "e138e903b8e7464eaa33982beed4f8bd"
format_stamp: "Formatted at 2026-08-09 23:19:27 on dist-test-slave-6nmv"
server_key: "d9486d92b91426103a5dff0c564e3869"
server_key_iv: "7b8957fae3bd53c0974b4883c97797af"
server_key_version: "encryptionkey@0"
I20260809 23:19:27.226663 9296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:27.235383 9296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:27.236797 9296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:27.240528 9296 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.189:42473
I20260809 23:19:27.240783 9487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.189:42473 every 8 connection(s)
I20260809 23:19:27.240922 9296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-1/data/info.pb
I20260809 23:19:27.241917 9488 sys_catalog.cc:263] Verifying existing consensus state
I20260809 23:19:27.242439 9488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: Bootstrap starting.
I20260809 23:19:27.245651 9488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 23:19:27.245929 9488 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: Bootstrap complete.
I20260809 23:19:27.246150 9488 raft_consensus.cc:348] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: NON_VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: true } }
I20260809 23:19:27.246239 9488 raft_consensus.cc:729] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e138e903b8e7464eaa33982beed4f8bd, State: Initialized, Role: LEARNER
I20260809 23:19:27.246280 9488 consensus_queue.cc:260] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: NON_VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: true } }
I20260809 23:19:27.246449 9488 sys_catalog.cc:564] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:27.246455 9491 sys_catalog.cc:455] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: NON_VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: true } } }
I20260809 23:19:27.246592 9491 sys_catalog.cc:458] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [sys.catalog]: This master's current role is: LEARNER
I20260809 23:19:27.247967 9503 catalog_manager.cc:1259] Loaded cluster ID: e910e5b17cb44a04990f05798ec75788
I20260809 23:19:27.248059 9503 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: loading cluster ID for follower catalog manager: success
I20260809 23:19:27.249065 9503 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: acquiring CA information for follower catalog manager: success
I20260809 23:19:27.249329 9503 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 23:19:27.258765 9504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.251727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60046 (local address 127.1.235.189:42473)
0809 23:19:27.251838 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.251840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.251852 (+ 12us) server_negotiation.cc:407] Connection header received
0809 23:19:27.251876 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.251876 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.251888 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.252015 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.252527 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.253553 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.254376 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.254694 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.254779 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.255977 (+ 1198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.255979 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.255979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.255987 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.257611 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.257983 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.257985 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.257985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.258053 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.258235 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.258236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.258236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.258372 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.258478 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.258556 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.258650 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":44,"threads_started":1}
WARNING: no policy specified for oryx/127.1.235.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.235.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.235.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.188.keytab.
Entry for principal oryx/127.1.235.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.188.keytab.
I20260809 23:19:27.284613 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.188:42377
--webserver_interface=127.1.235.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.188.keytab
--principal=oryx/127.1.235.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:35155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:44145,127.1.235.189:42473,127.1.235.188:42377
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:27.364764 9507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:27.364935 9507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:27.364955 9507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:27.366032 9507 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:27.366068 9507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:27.366081 9507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:27.366093 9507 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:27.366104 9507 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:19:27.367501 9507 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:35155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:44145,127.1.235.189:42473,127.1.235.188:42377
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.188.keytab
--principal=oryx/127.1.235.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.188:42377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.235.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:27.367688 9507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:27.367849 9507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:27.372483 9517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:27.372552 9513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:27.372480 9514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:27.372681 9507 server_base.cc:1034] running on GCE node
I20260809 23:19:27.372932 9507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:27.373214 9507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:27.374375 9507 hybrid_clock.cc:648] HybridClock initialized: now 1786317567374366 us; error 28 us; skew 500 ppm
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:27.376832 9507 init.cc:377] Logged in from keytab as oryx/127.1.235.188@KRBTEST.COM (short username oryx)
I20260809 23:19:27.377266 9507 webserver.cc:460] Webserver started at http://127.1.235.188:40623/ using document root <none> and password file <none>
I20260809 23:19:27.377451 9507 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:27.377490 9507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:27.377583 9507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:27.378592 9507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/data/instance:
uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c"
format_stamp: "Formatted at 2026-08-09 23:19:27 on dist-test-slave-6nmv"
server_key: "d1fb55e6e1f862ae1b546634f408b689"
server_key_iv: "af51e4de191b1e3c2d579c97f6a6fc16"
server_key_version: "encryptionkey@0"
I20260809 23:19:27.378957 9507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/wal/instance:
uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c"
format_stamp: "Formatted at 2026-08-09 23:19:27 on dist-test-slave-6nmv"
server_key: "d1fb55e6e1f862ae1b546634f408b689"
server_key_iv: "af51e4de191b1e3c2d579c97f6a6fc16"
server_key_version: "encryptionkey@0"
I20260809 23:19:27.380213 9507 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 23:19:27.380900 9524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.381063 9507 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:19:27.381146 9507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/wal
uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c"
format_stamp: "Formatted at 2026-08-09 23:19:27 on dist-test-slave-6nmv"
server_key: "d1fb55e6e1f862ae1b546634f408b689"
server_key_iv: "af51e4de191b1e3c2d579c97f6a6fc16"
server_key_version: "encryptionkey@0"
I20260809 23:19:27.381199 9507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:27.398312 9507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:27.400224 9507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:27.400331 9507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:27.404770 9507 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.188:42377
I20260809 23:19:27.404824 9581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.188:42377 every 8 connection(s)
I20260809 23:19:27.405156 9507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/data/info.pb
I20260809 23:19:27.406090 9582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:27.407557 9582 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:19:27.409742 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 9507
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.188@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.235.188@KRBTEST.COM
I20260809 23:19:27.417449 8813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.408349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46676 (local address 127.1.235.190:44145)
0809 23:19:27.408424 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.408425 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.408471 (+ 46us) server_negotiation.cc:407] Connection header received
0809 23:19:27.408914 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.408915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.408924 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.408979 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.409532 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.410264 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.411786 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.411987 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.412074 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.414513 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.414514 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.414515 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.414522 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.416039 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.416492 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.416494 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.416494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.416551 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.416791 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.416792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.416792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.416937 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.417012 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.417270 (+ 258us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.417360 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 23:19:27.417620 9584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.408198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:46676)
0809 23:19:27.408370 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.408407 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.408838 (+ 431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.409033 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.409036 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.409261 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.409458 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.409461 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.410371 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.410372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.411694 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.411698 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.412101 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.412102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.412227 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.412699 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.412708 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.414411 (+ 1703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.416114 (+ 1703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.416121 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.416123 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.416380 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.416620 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.416621 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.416621 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.416727 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.417002 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.417009 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.417143 (+ 134us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.417247 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.417400 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":88,"threads_started":1}
I20260809 23:19:27.418126 9582 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:19:27.419016 9585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.410403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53250 (local address 127.1.235.188:42377)
0809 23:19:27.410581 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.410585 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.410604 (+ 19us) server_negotiation.cc:407] Connection header received
0809 23:19:27.410622 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.410623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.410637 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.410701 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.411457 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.412271 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.413256 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.413640 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.413704 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.416095 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.416106 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.416107 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.416112 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.417802 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.418198 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.418201 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.418201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.418279 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.418468 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.418469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.418469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.418654 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.418800 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.418845 (+ 45us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.418927 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":102,"threads_started":1}
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.188@KRBTEST.COM for oryx/127.1.235.189@KRBTEST.COM
I20260809 23:19:27.424085 9584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.418379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:42473 (local address 127.0.0.1:60060)
0809 23:19:27.418426 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.418435 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.418467 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.418619 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.418620 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.418768 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.418796 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.418797 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.419649 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.419649 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.420112 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.420113 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.420419 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.420420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.420458 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.420751 (+ 293us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.420754 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.421795 (+ 1041us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.423339 (+ 1544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.423339 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.423340 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.423488 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.423649 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.423663 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.423663 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.423709 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.423899 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.423900 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.423929 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.423973 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.424032 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 23:19:27.424130 9504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.418454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60060 (local address 127.1.235.189:42473)
0809 23:19:27.418503 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.418505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.418513 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:19:27.418550 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.418550 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.418560 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.418601 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.418878 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.419591 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.420174 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.420356 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.420403 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.421897 (+ 1494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.421898 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.421899 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.421905 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.423275 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.423553 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.423554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.423554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.423601 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.423745 (+ 144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.423745 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.423745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.423826 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.423901 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.423992 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.424054 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 23:19:27.424474 9582 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42377 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.188@KRBTEST.COM for oryx/127.1.235.188@KRBTEST.COM
I20260809 23:19:27.430306 9585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.424749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53262 (local address 127.1.235.188:42377)
0809 23:19:27.424781 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.424783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.424791 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:19:27.424813 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.424814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.424822 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.424872 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.425097 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.425590 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.426262 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.426583 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.426658 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.428161 (+ 1503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.428162 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.428162 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.428168 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.429295 (+ 1127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.429584 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.429584 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.429585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.429627 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.429775 (+ 148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.429776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.429776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.429914 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.429985 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.430138 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.430220 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":18}
I20260809 23:19:27.430311 9584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.424689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42377 (local address 127.0.0.1:53262)
0809 23:19:27.424729 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.424738 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.424773 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.424875 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.424875 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.425009 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.425030 (+ 21us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.425032 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.425659 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.425660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.426178 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.426180 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.426659 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.426660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.426707 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.426988 (+ 281us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.426991 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.428092 (+ 1101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.429360 (+ 1268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.429360 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.429361 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.429516 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.429673 (+ 157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.429674 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.429674 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.429717 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.429993 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.429993 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.430032 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.430101 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.430203 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260809 23:19:27.431551 9582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: Bootstrap starting.
I20260809 23:19:27.432418 9582 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:27.432657 9582 log.cc:824] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:27.433295 9582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: No bootstrap required, opened a new log
I20260809 23:19:27.434891 9582 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42377 } }
I20260809 23:19:27.434998 9582 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:27.435019 9582 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc6d5448a8446e8ae6d10b97de4ef8c, State: Initialized, Role: FOLLOWER
I20260809 23:19:27.435119 9582 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42377 } }
I20260809 23:19:27.435403 9582 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:27.435352 9587 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42377 } } }
I20260809 23:19:27.435469 9587 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c [sys.catalog]: This master's current role is: FOLLOWER
W20260809 23:19:27.437232 9600 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 23:19:27.437284 9600 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:19:27.439517 9507 master_runner.cc:428] Detected that this master 4bc6d5448a8446e8ae6d10b97de4ef8c is joining an existing cluster
I20260809 23:19:27.439558 9507 master_runner.cc:432] Initiating AddMaster RPC to add 127.1.235.188:42377
I20260809 23:19:27.447252 9611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.440852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42377 (local address 127.0.0.1:53266)
0809 23:19:27.441037 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.441047 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.441120 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.441263 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.441264 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.441572 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.441665 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.441667 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.442544 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.442544 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.443312 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.443315 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.443766 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.443766 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.443819 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.444211 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.444216 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.444648 (+ 432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.446197 (+ 1549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.446198 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.446198 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.446397 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.446566 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.446567 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.446567 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.446646 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.446894 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.446895 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.446939 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.447024 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.447122 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":1,"thread_start_us":76,"threads_started":1}
I20260809 23:19:27.447242 9585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.440865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53266 (local address 127.1.235.188:42377)
0809 23:19:27.440907 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.440909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.441100 (+ 191us) server_negotiation.cc:407] Connection header received
0809 23:19:27.441183 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.441184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.441191 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.441217 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.441752 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.442429 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.443398 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.443651 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.443689 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.444728 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.444729 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.444730 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.444735 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.446126 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.446464 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.446465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.446465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.446511 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.446706 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.446706 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.446706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.446807 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.446901 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.447042 (+ 141us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.447166 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":66,"server-negotiator.queue_time_us":28}
I20260809 23:19:27.466390 8813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.441015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46682 (local address 127.1.235.190:44145)
0809 23:19:27.441072 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.441073 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.441081 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:19:27.441105 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.441106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.441117 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.441176 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.441549 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.442298 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.443384 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.443675 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.443713 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.463436 (+ 19723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.463437 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.463438 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.463445 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.464938 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.465477 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.465478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.465478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.465547 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.465772 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.465773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.465774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.465958 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.466005 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.466228 (+ 223us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.466300 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 23:19:27.466423 9613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.440564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:46682)
0809 23:19:27.440968 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.440977 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.441018 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.441199 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.441200 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.441403 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.441459 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.441461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.442390 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.442391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.443289 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.443291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.443792 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.443793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.443855 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.462542 (+ 18687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.462548 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.463351 (+ 803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.465063 (+ 1712us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.465063 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.465064 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.465403 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.465618 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.465618 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.465618 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.465684 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.466057 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.466058 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.466102 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.466193 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.466299 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":1,"spinlock_wait_cycles":8576,"thread_start_us":121,"threads_started":1}
I20260809 23:19:27.466495 9504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.440596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60062 (local address 127.1.235.189:42473)
0809 23:19:27.440644 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.440646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.440811 (+ 165us) server_negotiation.cc:407] Connection header received
0809 23:19:27.440931 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.440932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.440945 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.440980 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.441529 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.442303 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.443392 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.443673 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.443713 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.463169 (+ 19456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.463171 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.463171 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.463179 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.464974 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.465634 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.465635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.465635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.465710 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.465936 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.465937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.465938 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.466073 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.466153 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.466321 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.466404 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 23:19:27.467089 9612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.440554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:42473 (local address 127.0.0.1:60062)
0809 23:19:27.440750 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.440758 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.440824 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.441053 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.441054 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.441333 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.441431 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.441433 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.442400 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.442401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.443286 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.443288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.443791 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.443792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.443855 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.462542 (+ 18687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.462548 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.463058 (+ 510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.465049 (+ 1991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.465050 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.465051 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.465403 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.465787 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.465788 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.465788 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.465869 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.466151 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.466152 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.466196 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.466878 (+ 682us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.466984 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":5,"thread_start_us":73,"threads_started":1}
I20260809 23:19:27.470079 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 8839
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317566, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.190@KRBTEST.COM for oryx/127.1.235.188@KRBTEST.COM
I20260809 23:19:27.476403 9585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.468640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53282 (local address 127.1.235.188:42377)
0809 23:19:27.468691 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.468692 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.468700 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:19:27.468728 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.468729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.468738 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.468786 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.469017 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.469665 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.470640 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.470950 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.471007 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.473453 (+ 2446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.473454 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.473455 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.473461 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.475125 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.475535 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.475536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.475536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.475588 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.475855 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.475856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.475856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.476004 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.476069 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.476259 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.476327 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 23:19:27.476469 9400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.468436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42377 (local address 127.0.0.1:53282)
0809 23:19:27.468544 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.468552 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.468586 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.468806 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.468807 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.468922 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.468959 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.468960 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.469753 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.469754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.470551 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.470553 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.471055 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.471056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.471119 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.471557 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.471563 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.473373 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.475197 (+ 1824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.475198 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.475199 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.475456 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.475654 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.475655 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.475655 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.475783 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.476075 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.476076 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.476126 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.476209 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.476324 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88}
I20260809 23:19:27.477161 8769 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.1.235.188:42377: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c"
member_type: NON_VOTER
last_known_addr {
host: "127.1.235.188"
port: 42377
}
attrs {
promote: true
}
}
dest_uuid: "573e223d38144aab863d5ff5f1849722"
cas_config_opid_index: 5
I20260809 23:19:27.477442 8769 consensus_queue.cc:237] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: NON_VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: true } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } }
I20260809 23:19:27.477922 9404 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4bc6d5448a8446e8ae6d10b97de4ef8c (127.1.235.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: NON_VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: true } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } } }
I20260809 23:19:27.479274 9404 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.1.235.188:42377
I20260809 23:19:27.479357 9404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "573e223d38144aab863d5ff5f1849722" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: NON_VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: true } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } } }
I20260809 23:19:27.479466 9404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:27.480122 9554 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:27.481501 9554 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c [term 1 FOLLOWER]: Refusing update from remote peer 573e223d38144aab863d5ff5f1849722: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 23:19:27.481884 9507 master.cc:537] Master@127.1.235.188:42377 shutting down...
I20260809 23:19:27.482007 9404 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:27.488257 9400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.479690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:42473 (local address 127.0.0.1:60064)
0809 23:19:27.484985 (+ 5295us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.484996 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.485039 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.485247 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.485248 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.485249 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:27.485279 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.485280 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.486118 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.486119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.487238 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.487241 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.488038 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.488039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.488100 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.488119 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.488167 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.488198 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5280}
I20260809 23:19:27.488569 9504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.479799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60064 (local address 127.1.235.189:42473)
0809 23:19:27.479835 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.479836 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.485091 (+ 5255us) server_negotiation.cc:407] Connection header received
0809 23:19:27.485113 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.485114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.485137 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.485199 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:27.485340 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.486028 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.487327 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.487876 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.487940 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.488006 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.488464 (+ 458us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.488500 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:19:27.491303 9457 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 LEARNER]: Refusing update from remote peer 573e223d38144aab863d5ff5f1849722: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 23:19:27.491564 9405 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: NON_VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 23:19:27.492146 9457 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4bc6d5448a8446e8ae6d10b97de4ef8c (127.1.235.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: NON_VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: true } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } } }
I20260809 23:19:27.493716 9491 sys_catalog.cc:455] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 573e223d38144aab863d5ff5f1849722. Latest consensus state: current_term: 1 leader_uuid: "573e223d38144aab863d5ff5f1849722" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: NON_VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: true } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } } }
I20260809 23:19:27.493841 9491 sys_catalog.cc:458] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [sys.catalog]: This master's current role is: LEARNER
I20260809 23:19:27.493885 9491 sys_catalog.cc:455] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "573e223d38144aab863d5ff5f1849722" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: NON_VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: true } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } } }
I20260809 23:19:27.493954 9491 sys_catalog.cc:458] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [sys.catalog]: This master's current role is: LEARNER
I20260809 23:19:27.494192 9405 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722: attempting to promote NON_VOTER e138e903b8e7464eaa33982beed4f8bd to VOTER
I20260809 23:19:27.494369 9405 consensus_queue.cc:237] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } }
I20260809 23:19:27.494787 9457 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 LEARNER]: Refusing update from remote peer 573e223d38144aab863d5ff5f1849722: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 23:19:27.494957 9404 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260809 23:19:27.495388 8755 consensus_peers.cc:487] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 -> Peer 4bc6d5448a8446e8ae6d10b97de4ef8c (127.1.235.188:42377): Couldn't send request to peer 4bc6d5448a8446e8ae6d10b97de4ef8c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 23:19:27.496739 9404 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, e138e903b8e7464eaa33982beed4f8bd (127.1.235.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } } }
I20260809 23:19:27.497156 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:32795
--local_ip_for_outbound_sockets=127.1.235.129
--tserver_master_addrs=127.1.235.190:44145
--webserver_port=34365
--webserver_interface=127.1.235.129
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.129.keytab
--principal=oryx/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:35155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.1.235.190:44145,127.1.235.189:42473
--tserver_master_addrs=127.1.235.190:44145,127.1.235.189:42473,127.1.235.188:42377 with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:19:27.497568 9507 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:27.497718 9507 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:27.497876 9507 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: stopping tablet replica
I20260809 23:19:27.497795 9404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "573e223d38144aab863d5ff5f1849722" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } } }
I20260809 23:19:27.497915 9404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:27.497980 9404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "573e223d38144aab863d5ff5f1849722" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } } }
I20260809 23:19:27.498047 9404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:27.498364 9457 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, e138e903b8e7464eaa33982beed4f8bd (127.1.235.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } } }
I20260809 23:19:27.499519 9616 sys_catalog.cc:455] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "573e223d38144aab863d5ff5f1849722" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } } }
I20260809 23:19:27.499629 9616 sys_catalog.cc:458] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 23:19:27.501299 9507 master.cc:552] Master@127.1.235.188:42377 shutdown complete.
I20260809 23:19:27.501363 9507 master_runner.cc:305] Clearing existing system tablet
I20260809 23:19:27.501500 9507 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:27.501559 9507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:27.502245 9507 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:19:27.502718 9620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.502861 9507 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:27.502913 9507 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.502940 9507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/wal
uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c"
format_stamp: "Formatted at 2026-08-09 23:19:27 on dist-test-slave-6nmv"
server_key: "d1fb55e6e1f862ae1b546634f408b689"
server_key_iv: "af51e4de191b1e3c2d579c97f6a6fc16"
server_key_version: "encryptionkey@0"
I20260809 23:19:27.503497 9507 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:27.504493 9507 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 23:19:27.504570 9507 log.cc:1196] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 23:19:27.504771 9507 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: Deleting consensus metadata
I20260809 23:19:27.504880 9507 master_runner.cc:315] Copying system tablet from 127.1.235.190:44145
I20260809 23:19:27.505456 9507 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: tablet copy: Beginning tablet copy session from remote peer at address 127.1.235.190:44145
I20260809 23:19:27.511154 8813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.505762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46684 (local address 127.1.235.190:44145)
0809 23:19:27.505802 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.505804 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.505960 (+ 156us) server_negotiation.cc:407] Connection header received
0809 23:19:27.506011 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.506012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.506021 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.506071 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.506362 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.506833 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.507514 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.507722 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.507803 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.508691 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.508693 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.508693 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.508700 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.510065 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.510408 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.510409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.510410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.510464 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.510642 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.510643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.510643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.510766 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.510841 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.510989 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.511068 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:19:27.511196 9626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.505735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:46684)
0809 23:19:27.505877 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.505886 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.505955 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.506076 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.506076 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.506253 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.506292 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.506293 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.506915 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.506916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.507427 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.507428 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.507802 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.507803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.507857 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.508296 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.508301 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.508592 (+ 291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.510157 (+ 1565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.510157 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.510158 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.510318 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.510523 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.510524 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.510524 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.510579 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.510833 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.510834 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.510880 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.510963 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.511069 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":67,"threads_started":1}
I20260809 23:19:27.511667 8793 tablet_copy_service.cc:140] P 573e223d38144aab863d5ff5f1849722: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 4bc6d5448a8446e8ae6d10b97de4ef8c ({username='oryx', principal='oryx/127.1.235.188@KRBTEST.COM'} at 127.0.0.1:46684)
I20260809 23:19:27.511737 8793 tablet_copy_service.cc:161] P 573e223d38144aab863d5ff5f1849722: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 4bc6d5448a8446e8ae6d10b97de4ef8c at {username='oryx', principal='oryx/127.1.235.188@KRBTEST.COM'} at 127.0.0.1:46684: session id = 4bc6d5448a8446e8ae6d10b97de4ef8c-00000000000000000000000000000000
I20260809 23:19:27.512148 8793 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 23:19:27.512590 9507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 23:19:27.513393 9507 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: tablet copy: Starting download of 0 data blocks...
I20260809 23:19:27.513531 9507 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: tablet copy: Starting download of 1 WAL segments...
I20260809 23:19:27.514335 9507 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 23:19:27.515086 8793 tablet_copy_service.cc:342] P 573e223d38144aab863d5ff5f1849722: Request end of tablet copy session 4bc6d5448a8446e8ae6d10b97de4ef8c-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.1.235.188@KRBTEST.COM'} at 127.0.0.1:46684
I20260809 23:19:27.515164 8793 tablet_copy_service.cc:433] P 573e223d38144aab863d5ff5f1849722: ending tablet copy session 4bc6d5448a8446e8ae6d10b97de4ef8c-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 4bc6d5448a8446e8ae6d10b97de4ef8c
I20260809 23:19:27.517242 9507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:27.518404 9629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:27.518412 9628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:27.518623 9631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:27.518810 9507 server_base.cc:1034] running on GCE node
I20260809 23:19:27.518898 9507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:27.519013 9507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:27.520131 9507 hybrid_clock.cc:648] HybridClock initialized: now 1786317567520127 us; error 20 us; skew 500 ppm
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:27.521422 9507 init.cc:377] Logged in from keytab as oryx/127.1.235.188@KRBTEST.COM (short username oryx)
I20260809 23:19:27.521696 9507 webserver.cc:460] Webserver started at http://127.1.235.188:38675/ using document root <none> and password file <none>
I20260809 23:19:27.521834 9507 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:27.521872 9507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:27.522429 9507 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.522887 9638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.523020 9507 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.523062 9507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/wal
uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c"
format_stamp: "Formatted at 2026-08-09 23:19:27 on dist-test-slave-6nmv"
server_key: "d1fb55e6e1f862ae1b546634f408b689"
server_key_iv: "af51e4de191b1e3c2d579c97f6a6fc16"
server_key_version: "encryptionkey@0"
I20260809 23:19:27.523123 9507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:27.536011 9507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:27.537631 9507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:27.541198 9507 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.188:42377
I20260809 23:19:27.541534 9507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/master-2/data/info.pb
I20260809 23:19:27.541877 9694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.188:42377 every 8 connection(s)
I20260809 23:19:27.542354 9697 sys_catalog.cc:263] Verifying existing consensus state
I20260809 23:19:27.542798 9697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: Bootstrap starting.
I20260809 23:19:27.544953 9697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 23:19:27.545178 9697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: Bootstrap complete.
I20260809 23:19:27.545361 9697 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } }
I20260809 23:19:27.545444 9697 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4bc6d5448a8446e8ae6d10b97de4ef8c, State: Initialized, Role: LEARNER
I20260809 23:19:27.545487 9697 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } }
I20260809 23:19:27.545675 9697 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:27.545670 9701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } } }
I20260809 23:19:27.546000 9701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c [sys.catalog]: This master's current role is: LEARNER
I20260809 23:19:27.547240 9712 catalog_manager.cc:1259] Loaded cluster ID: e910e5b17cb44a04990f05798ec75788
I20260809 23:19:27.547335 9712 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: loading cluster ID for follower catalog manager: success
I20260809 23:19:27.548512 9712 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: acquiring CA information for follower catalog manager: success
I20260809 23:19:27.548779 9712 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4bc6d5448a8446e8ae6d10b97de4ef8c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 23:19:27.613380 9618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:27.613628 9618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:27.613662 9618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:27.615406 9618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:27.615483 9618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:27.615523 9618 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:19:27.617483 9618 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:35155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.129.keytab
--principal=oryx/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:32795
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=34365
--tserver_master_addrs=127.1.235.190:44145,127.1.235.189:42473,127.1.235.188:42377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9618
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:27.617697 9618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:27.617959 9618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:27.623100 9718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:27.623126 9719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:27.623147 9721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:27.623283 9618 server_base.cc:1034] running on GCE node
I20260809 23:19:27.623503 9618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:27.623835 9618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:27.624967 9618 hybrid_clock.cc:648] HybridClock initialized: now 1786317567624946 us; error 38 us; skew 500 ppm
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:27.627308 9618 init.cc:377] Logged in from keytab as oryx/127.1.235.129@KRBTEST.COM (short username oryx)
I20260809 23:19:27.627646 9618 webserver.cc:460] Webserver started at http://127.1.235.129:34365/ using document root <none> and password file <none>
I20260809 23:19:27.627830 9618 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:27.627894 9618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:27.629032 9618 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:27.629611 9728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.629791 9618 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:27.629902 9618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "bf963feece204c379c42d6add1d14363"
format_stamp: "Formatted at 2026-08-09 23:19:26 on dist-test-slave-6nmv"
server_key: "8176f04518c11c72386bb1526f2957ed"
server_key_iv: "0f8a34ea5724b63701561631db6919a5"
server_key_version: "encryptionkey@0"
I20260809 23:19:27.630198 9618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:27.640065 9618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:27.641988 9618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:27.642128 9618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:27.642328 9618 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:27.642614 9618 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:27.642647 9618 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.642693 9618 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:27.642719 9618 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.649093 9618 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:32795
I20260809 23:19:27.649212 9856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:32795 every 8 connection(s)
I20260809 23:19:27.649592 9618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:19:27.653944 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 9618
I20260809 23:19:27.654116 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 8994
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.189@KRBTEST.COM
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.188@KRBTEST.COM
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM
I20260809 23:19:27.661998 9504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.650836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:40359 (local address 127.1.235.189:42473)
0809 23:19:27.650913 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.650916 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.650929 (+ 13us) server_negotiation.cc:407] Connection header received
0809 23:19:27.651344 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.651346 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.651370 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.651409 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.652318 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.653046 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.654174 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.654463 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.654507 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.658399 (+ 3892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.658400 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.658400 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.658407 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.660108 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.660773 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.660774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.660775 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.660835 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.661160 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.661161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.661161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.661310 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.661358 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.661752 (+ 394us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.661878 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 23:19:27.661999 8813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.650775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:41043 (local address 127.1.235.190:44145)
0809 23:19:27.650822 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.650825 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.651022 (+ 197us) server_negotiation.cc:407] Connection header received
0809 23:19:27.651324 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.651325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.651341 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.651398 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.652299 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.652938 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.654212 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.654524 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.654565 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.658373 (+ 3808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.658374 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.658374 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.658382 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.660630 (+ 2248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.661063 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.661065 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.661065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.661130 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.661353 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.661353 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.661354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.661499 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.661546 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.661764 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.661883 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 23:19:27.662395 9865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.650339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:41043)
0809 23:19:27.650951 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.650960 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.651222 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.651527 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.651532 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.652017 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.652197 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.652202 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.653026 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.653027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.654074 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.654077 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.654676 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.654677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.654768 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.655629 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.655639 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.658282 (+ 2643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.660725 (+ 2443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.660726 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.660726 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.660969 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.661212 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.661213 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.661213 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.661270 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.661601 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.661601 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.661638 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.662122 (+ 484us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.662263 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"mutex_wait_us":58,"thread_start_us":100,"threads_started":1}
I20260809 23:19:27.662393 9862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.650338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:42473 (local address 127.1.235.129:40359)
0809 23:19:27.650541 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.650580 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.651209 (+ 629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.651529 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.651533 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.652022 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.652198 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.652203 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.653151 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.653152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.654069 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.654071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.654587 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.654587 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.654720 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.655763 (+ 1043us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.655767 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.658282 (+ 2515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.660206 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.660207 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.660208 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.660662 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.660934 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.660935 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.660935 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.661072 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.661412 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.661419 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.661568 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.662082 (+ 514us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.662193 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":117,"threads_started":1}
I20260809 23:19:27.663091 9867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.650633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:50543 (local address 127.1.235.188:42377)
0809 23:19:27.650907 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.650908 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.651383 (+ 475us) server_negotiation.cc:407] Connection header received
0809 23:19:27.651450 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.651451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.651465 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.651539 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.652318 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.653242 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.654196 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.654468 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.654524 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.657870 (+ 3346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.657872 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.657873 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.657881 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.660066 (+ 2185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.660794 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.660796 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.660796 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.660868 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.661159 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.661161 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.661161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.661341 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.661412 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.662838 (+ 1426us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.662947 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":60,"threads_started":1}
I20260809 23:19:27.663612 9864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.650339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42377 (local address 127.1.235.129:50543)
0809 23:19:27.651319 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.651329 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.651386 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.651595 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.651596 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.652031 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.652198 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.652203 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.653365 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.653366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.654109 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.654111 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.654586 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.654587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.654720 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.655675 (+ 955us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.655678 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.657740 (+ 2062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.660180 (+ 2440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.660188 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.660191 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.660681 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.660955 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.660957 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.660957 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.661077 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.661446 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.661447 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.661583 (+ 136us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.661704 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.661985 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":720,"mutex_wait_us":9,"spinlock_wait_cycles":7040,"thread_start_us":117,"threads_started":1}
I20260809 23:19:27.664091 9857 heartbeater.cc:347] Connected to a master server at 127.1.235.188:42377
I20260809 23:19:27.664214 9857 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:27.664470 9857 heartbeater.cc:511] Master 127.1.235.188:42377 requested a full tablet report, sending...
I20260809 23:19:27.665014 9646 ts_manager.cc:194] Registered new tserver with Master: bf963feece204c379c42d6add1d14363 (127.1.235.129:32795)
I20260809 23:19:27.666317 9859 heartbeater.cc:347] Connected to a master server at 127.1.235.190:44145
I20260809 23:19:27.666363 9859 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:27.666416 9859 heartbeater.cc:511] Master 127.1.235.190:44145 requested a full tablet report, sending...
I20260809 23:19:27.666679 8769 ts_manager.cc:194] Re-registered known tserver with Master: bf963feece204c379c42d6add1d14363 (127.1.235.129:32795)
I20260809 23:19:27.667119 8769 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:41043
I20260809 23:19:27.669903 9860 heartbeater.cc:347] Connected to a master server at 127.1.235.189:42473
I20260809 23:19:27.669960 9860 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:27.670035 9860 heartbeater.cc:511] Master 127.1.235.189:42473 requested a full tablet report, sending...
I20260809 23:19:27.670403 9444 ts_manager.cc:194] Registered new tserver with Master: bf963feece204c379c42d6add1d14363 (127.1.235.129:32795)
I20260809 23:19:27.671294 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:35349
--local_ip_for_outbound_sockets=127.1.235.130
--tserver_master_addrs=127.1.235.190:44145
--webserver_port=35347
--webserver_interface=127.1.235.130
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.130.keytab
--principal=oryx/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:35155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.1.235.190:44145,127.1.235.189:42473
--tserver_master_addrs=127.1.235.190:44145,127.1.235.189:42473,127.1.235.188:42377 with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:27.748675 9869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:27.748859 9869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:27.748889 9869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:27.749908 9869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:27.749956 9869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:27.749995 9869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:19:27.751374 9869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:35155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.130.keytab
--principal=oryx/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:35349
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=35347
--tserver_master_addrs=127.1.235.190:44145,127.1.235.189:42473,127.1.235.188:42377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:27.751627 9869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:27.751842 9869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:27.756593 9875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:27.756620 9874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:27.756647 9869 server_base.cc:1034] running on GCE node
W20260809 23:19:27.756650 9877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:27.756946 9869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:27.757153 9869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:27.758296 9869 hybrid_clock.cc:648] HybridClock initialized: now 1786317567758285 us; error 21 us; skew 500 ppm
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:27.760721 9869 init.cc:377] Logged in from keytab as oryx/127.1.235.130@KRBTEST.COM (short username oryx)
I20260809 23:19:27.761137 9869 webserver.cc:460] Webserver started at http://127.1.235.130:35347/ using document root <none> and password file <none>
I20260809 23:19:27.761337 9869 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:27.761404 9869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:27.762691 9869 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:19:27.763156 9885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.763309 9869 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.763383 9869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "8144f47baac64d2080c8bb6e16304891"
format_stamp: "Formatted at 2026-08-09 23:19:26 on dist-test-slave-6nmv"
server_key: "927b66ea885fac8bb602292968b69fa4"
server_key_iv: "6fa1053db7fcf5e70087932dd3a28b91"
server_key_version: "encryptionkey@0"
I20260809 23:19:27.763628 9869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:27.779513 9869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:27.781407 9869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:27.781507 9869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:27.781662 9869 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:27.781946 9869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:27.781996 9869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.782012 9869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:27.782029 9869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.787256 9869 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:35349
I20260809 23:19:27.787328 10011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:35349 every 8 connection(s)
I20260809 23:19:27.787590 9869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.188@KRBTEST.COM
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.189@KRBTEST.COM
I20260809 23:19:27.796272 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 9869
I20260809 23:19:27.796435 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 9144
I20260809 23:19:27.798960 9867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.788482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:54393 (local address 127.1.235.188:42377)
0809 23:19:27.788524 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.788526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.788731 (+ 205us) server_negotiation.cc:407] Connection header received
0809 23:19:27.789550 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.789551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.789567 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.789595 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.790449 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.791239 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.792355 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.792657 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.792734 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.794714 (+ 1980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.794715 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.794716 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.794722 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.796068 (+ 1346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.797782 (+ 1714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.797783 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.797784 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.797869 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.798162 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.798163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.798163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.798289 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.798329 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.798727 (+ 398us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.798826 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:19:27.799062 10016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.788195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42377 (local address 127.1.235.130:54393)
0809 23:19:27.788673 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.788683 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.789428 (+ 745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.789656 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.789657 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.790179 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.790346 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.790351 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.791334 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.791335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.792246 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.792248 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.792734 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.792735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.792807 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.793147 (+ 340us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.793151 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.794618 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.797382 (+ 2764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.797389 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.797391 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.797691 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.797960 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.797960 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.797961 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.798084 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.798373 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.798407 (+ 34us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.798554 (+ 147us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.798676 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.798844 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"mutex_wait_us":22,"thread_start_us":92,"threads_started":1}
I20260809 23:19:27.799530 10012 heartbeater.cc:347] Connected to a master server at 127.1.235.188:42377
I20260809 23:19:27.799624 9504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.788498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:57575 (local address 127.1.235.189:42473)
0809 23:19:27.788542 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.788543 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.788553 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:19:27.789544 (+ 991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.789545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.789560 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.789591 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.790447 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.791230 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.792467 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.792776 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.792837 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.795717 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.795718 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.795718 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.795725 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.798270 (+ 2545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.798655 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.798656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.798657 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.798718 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.798914 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.798915 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.798915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.799038 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.799083 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.799458 (+ 375us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.799529 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 23:19:27.799624 10012 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:27.799829 10017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.788194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:42473 (local address 127.1.235.130:57575)
0809 23:19:27.788365 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.788398 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.789427 (+ 1029us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.789656 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.789657 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.790177 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.790346 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.790351 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.791334 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.791335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.792371 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.792373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.792843 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.792844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.792916 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.793307 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.793312 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.795632 (+ 2320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.798348 (+ 2716us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.798348 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.798349 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.798564 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.798788 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.798789 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.798789 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.798844 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.799308 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.799309 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.799366 (+ 57us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.799430 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.799519 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":76,"thread_start_us":98,"threads_started":1}
I20260809 23:19:27.799844 10012 heartbeater.cc:511] Master 127.1.235.188:42377 requested a full tablet report, sending...
I20260809 23:19:27.800292 9646 ts_manager.cc:194] Registered new tserver with Master: 8144f47baac64d2080c8bb6e16304891 (127.1.235.130:35349)
I20260809 23:19:27.800464 10014 heartbeater.cc:347] Connected to a master server at 127.1.235.189:42473
I20260809 23:19:27.800509 10014 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:27.800554 10014 heartbeater.cc:511] Master 127.1.235.189:42473 requested a full tablet report, sending...
I20260809 23:19:27.800846 9444 ts_manager.cc:194] Registered new tserver with Master: 8144f47baac64d2080c8bb6e16304891 (127.1.235.130:35349)
I20260809 23:19:27.802342 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:40061
--local_ip_for_outbound_sockets=127.1.235.131
--tserver_master_addrs=127.1.235.190:44145
--webserver_port=40691
--webserver_interface=127.1.235.131
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.131.keytab
--principal=oryx/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:35155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.1.235.190:44145,127.1.235.189:42473
--tserver_master_addrs=127.1.235.190:44145,127.1.235.189:42473,127.1.235.188:42377 with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:19:27.803754 10019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.788195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:57359)
0809 23:19:27.788694 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.788705 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.789434 (+ 729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.789652 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.789656 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.790176 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.790344 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.790348 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.791057 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.791058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.791847 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.791849 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.792233 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.792234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.792375 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.793002 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.793011 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.795630 (+ 2619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.802922 (+ 7292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.802923 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.802923 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.803078 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.803279 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.803279 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.803279 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.803321 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.803553 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.803554 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.803580 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.803618 (+ 38us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.803678 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"mutex_wait_us":2,"spinlock_wait_cycles":6528,"thread_start_us":97,"threads_started":1}
I20260809 23:19:27.803840 8813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.788483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:57359 (local address 127.1.235.190:44145)
0809 23:19:27.788526 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.788528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.788760 (+ 232us) server_negotiation.cc:407] Connection header received
0809 23:19:27.789524 (+ 764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.789525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.789538 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.789583 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.790434 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.790949 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.791941 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.792142 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.792212 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.795946 (+ 3734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.795947 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.795948 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.795954 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.802852 (+ 6898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.803150 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.803151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.803151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.803223 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.803370 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.803371 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.803371 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.803498 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.803553 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.803650 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.803726 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:19:27.804139 10013 heartbeater.cc:347] Connected to a master server at 127.1.235.190:44145
I20260809 23:19:27.804195 10013 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:27.804252 10013 heartbeater.cc:511] Master 127.1.235.190:44145 requested a full tablet report, sending...
I20260809 23:19:27.804443 8769 ts_manager.cc:194] Re-registered known tserver with Master: 8144f47baac64d2080c8bb6e16304891 (127.1.235.130:35349)
I20260809 23:19:27.804772 8769 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:57359
W20260809 23:19:27.880565 10020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:27.880749 10020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:27.880792 10020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:27.881891 10020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:27.881942 10020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:27.881979 10020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:19:27.883239 10020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:35155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.131.keytab
--principal=oryx/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:40061
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=40691
--tserver_master_addrs=127.1.235.190:44145,127.1.235.189:42473,127.1.235.188:42377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:27.883415 10020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:27.883571 10020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:27.888396 10026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:27.888444 10028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:27.888404 10025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:27.888567 10020 server_base.cc:1034] running on GCE node
I20260809 23:19:27.888747 10020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:27.889000 10020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:27.890158 10020 hybrid_clock.cc:648] HybridClock initialized: now 1786317567890147 us; error 31 us; skew 500 ppm
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:27.892603 10020 init.cc:377] Logged in from keytab as oryx/127.1.235.131@KRBTEST.COM (short username oryx)
I20260809 23:19:27.892956 10020 webserver.cc:460] Webserver started at http://127.1.235.131:40691/ using document root <none> and password file <none>
I20260809 23:19:27.893121 10020 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:27.893167 10020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:27.894351 10020 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:19:27.894836 10035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.894985 10020 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.895059 10020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "9be6f411651c42d39f0d15858ec42a45"
format_stamp: "Formatted at 2026-08-09 23:19:26 on dist-test-slave-6nmv"
server_key: "6f545196d8d0d9b60ae20a70f489d68f"
server_key_iv: "e189c85d6e0c6ca8a5fa37a241808dc1"
server_key_version: "encryptionkey@0"
I20260809 23:19:27.895299 10020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:27.922356 10020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:27.923981 10020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:27.924072 10020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:27.924242 10020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:19:27.924448 10020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:27.924475 10020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.924494 10020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:27.924505 10020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:27.930163 10020 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:40061
I20260809 23:19:27.930253 10162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:40061 every 8 connection(s)
I20260809 23:19:27.930513 10020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.189@KRBTEST.COM
I20260809 23:19:27.937795 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 10020
Aug 09 23:19:27 dist-test-slave-6nmv krb5kdc[8718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317567, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.188@KRBTEST.COM
I20260809 23:19:27.944630 10167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.931174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:42473 (local address 127.1.235.131:48577)
0809 23:19:27.931362 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.931408 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.931967 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.932227 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.932230 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.932591 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.932748 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.932755 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.933683 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.933684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.934568 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.934569 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.934938 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.934939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.935033 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.935604 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.935614 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.937546 (+ 1932us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.940278 (+ 2732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.940285 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.940287 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.940563 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.942176 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.942177 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.942178 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.942309 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.943365 (+ 1056us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.943372 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.943790 (+ 418us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.943889 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.944036 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":47,"thread_start_us":93,"threads_started":1}
I20260809 23:19:27.945418 9504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.931505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:48577 (local address 127.1.235.189:42473)
0809 23:19:27.931550 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.931552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.931563 (+ 11us) server_negotiation.cc:407] Connection header received
0809 23:19:27.932087 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.932098 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.932111 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.932160 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.932867 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.933584 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.934642 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.934874 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.934920 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.937630 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.937631 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.937631 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.937639 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.940190 (+ 2551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.942048 (+ 1858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.942050 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.942050 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.942107 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.943137 (+ 1030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.943138 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.943138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.943269 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.943334 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.945312 (+ 1978us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.945364 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 23:19:27.945732 10165 heartbeater.cc:347] Connected to a master server at 127.1.235.189:42473
I20260809 23:19:27.945842 10165 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:27.946033 10165 heartbeater.cc:511] Master 127.1.235.189:42473 requested a full tablet report, sending...
I20260809 23:19:27.946353 10169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.931174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:40179)
0809 23:19:27.931642 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.931650 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.931976 (+ 326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.932296 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.932297 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.932570 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.932747 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.932751 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.933472 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.933473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.934305 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.934307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.935252 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.935253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.935341 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.935842 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.935846 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.937264 (+ 1418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.945282 (+ 8018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.945283 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.945283 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.945468 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.945695 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.945695 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.945696 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.945750 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.946038 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.946039 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.946077 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.946144 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.946235 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":27,"thread_start_us":116,"threads_started":1}
I20260809 23:19:27.946406 9444 ts_manager.cc:194] Registered new tserver with Master: 9be6f411651c42d39f0d15858ec42a45 (127.1.235.131:40061)
I20260809 23:19:27.946513 8813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.931430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:40179 (local address 127.1.235.190:44145)
0809 23:19:27.931478 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.931480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.931699 (+ 219us) server_negotiation.cc:407] Connection header received
0809 23:19:27.932208 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.932208 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.932218 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.932275 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.932847 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.933380 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.934396 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.934575 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.934648 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.937356 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.937358 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.937358 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.937367 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.945228 (+ 7861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.945546 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.945548 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.945548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.945616 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.945843 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.945845 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.945845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.945955 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.946013 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.946342 (+ 329us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.946415 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:19:27.946806 10164 heartbeater.cc:347] Connected to a master server at 127.1.235.190:44145
I20260809 23:19:27.946856 10164 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:27.946931 10164 heartbeater.cc:511] Master 127.1.235.190:44145 requested a full tablet report, sending...
I20260809 23:19:27.947043 10177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.939296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60076 (local address 127.1.235.189:42473)
0809 23:19:27.939457 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.939459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.939467 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:19:27.939512 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.939513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.939525 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.939600 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.940244 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.941100 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.942194 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.942467 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.942502 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.943937 (+ 1435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.943938 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.943939 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.943945 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.945757 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.946150 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.946151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.946151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.946200 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.946381 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.946382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.946382 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.946512 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.946585 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.946828 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.946948 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":55,"threads_started":1}
I20260809 23:19:27.947160 8769 ts_manager.cc:194] Re-registered known tserver with Master: 9be6f411651c42d39f0d15858ec42a45 (127.1.235.131:40061)
I20260809 23:19:27.947440 10168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.931174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42377 (local address 127.1.235.131:51209)
0809 23:19:27.931539 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.931547 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.931967 (+ 420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.932578 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.932579 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.932720 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:27.932766 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.932768 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.933706 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.933707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.934563 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.934565 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.935203 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.935204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.935258 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.935672 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:27.935676 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:27.938314 (+ 2638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:27.945724 (+ 7410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.945725 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.945726 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.945960 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.946161 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:27.946161 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:27.946162 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:27.946742 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:27.947005 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:27.947006 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:27.947038 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.947106 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.947202 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"mutex_wait_us":30,"thread_start_us":117,"threads_started":1}
I20260809 23:19:27.947489 9867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.931454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:51209 (local address 127.1.235.188:42377)
0809 23:19:27.931557 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.931559 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.931594 (+ 35us) server_negotiation.cc:407] Connection header received
0809 23:19:27.932107 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.932109 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.932121 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.932150 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.932867 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.933587 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.934964 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.935135 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.935179 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.938429 (+ 3250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.938431 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.938431 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.938438 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.941452 (+ 3014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.946041 (+ 4589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.946043 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.946043 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.946098 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.946812 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.946813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.946813 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.946932 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.946977 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.947318 (+ 341us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.947393 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 23:19:27.947546 8769 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:40179
I20260809 23:19:27.947738 10163 heartbeater.cc:347] Connected to a master server at 127.1.235.188:42377
I20260809 23:19:27.947788 10163 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:27.947851 10163 heartbeater.cc:511] Master 127.1.235.188:42377 requested a full tablet report, sending...
I20260809 23:19:27.948168 9646 ts_manager.cc:194] Registered new tserver with Master: 9be6f411651c42d39f0d15858ec42a45 (127.1.235.131:40061)
I20260809 23:19:27.949779 10179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.939443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53292 (local address 127.1.235.188:42377)
0809 23:19:27.939667 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.939669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.939676 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:19:27.939695 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.939696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.939706 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.939771 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.940449 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.941187 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.942284 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.942572 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.942853 (+ 281us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.944030 (+ 1177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.944031 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.944031 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.944038 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.948784 (+ 4746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.949065 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.949066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.949066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.949129 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.949301 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.949302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.949302 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.949426 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.949519 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.949608 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.949687 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":58,"threads_started":1}
I20260809 23:19:27.950080 10178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.939400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46690 (local address 127.1.235.190:44145)
0809 23:19:27.940250 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.940252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.940259 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:19:27.940278 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.940279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.940291 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.941110 (+ 819us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:27.941147 (+ 37us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.941896 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.942891 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.943172 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.943470 (+ 298us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.944559 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:27.944560 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:27.944560 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:27.944566 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:27.949043 (+ 4477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.949307 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.949308 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.949308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.949354 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:27.949512 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:27.949513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:27.949513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:27.949626 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:27.949781 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.949836 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.949909 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":82,"threads_started":1}
I20260809 23:19:27.951459 8769 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46690:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:19:27.952997 8769 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:19:27.959929 9400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.956367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:35349 (local address 127.0.0.1:42158)
0809 23:19:27.956484 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.956494 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.956533 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.956961 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.956962 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.956963 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:27.956989 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.956990 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.958188 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.958189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.958900 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.958902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.959734 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.959735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.959791 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.959794 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.959834 (+ 40us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.959871 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":37}
I20260809 23:19:27.960135 10188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.956616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42158 (local address 127.1.235.130:35349)
0809 23:19:27.956807 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.956810 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.956818 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:19:27.956853 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.956854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.956867 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.956963 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:27.957065 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.958103 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.959004 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.959657 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.959728 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.959809 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.959843 (+ 34us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.959883 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":86,"threads_started":1}
I20260809 23:19:27.960203 10185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.956370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:40061 (local address 127.0.0.1:40498)
0809 23:19:27.956528 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.956536 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.956570 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.956828 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.956829 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.956831 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:27.956866 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.956868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.958013 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.958014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.959127 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.959130 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.959966 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.959967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.960047 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.960050 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.960095 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.960131 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":16,"thread_start_us":92,"threads_started":1}
I20260809 23:19:27.960350 10186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.956424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40498 (local address 127.1.235.131:40061)
0809 23:19:27.956674 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.956678 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.956688 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:19:27.956716 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.956718 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.956730 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.956825 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:27.956927 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.957934 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.959199 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.959815 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.959872 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.959932 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.960275 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.960309 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":61,"threads_started":1}
I20260809 23:19:27.960843 10184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.956397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:32795 (local address 127.0.0.1:41604)
0809 23:19:27.957046 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:27.957054 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:27.957107 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:27.957257 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:27.957258 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:27.957259 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:27.957301 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.957302 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.958302 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.958303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.959466 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:27.959468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.960606 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.960607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:27.960658 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.960661 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:19:27.960721 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 23:19:27.960759 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":635,"thread_start_us":92,"threads_started":1}
I20260809 23:19:27.960801 9941 tablet_service.cc:1467] Processing CreateTablet for tablet 26d1eb1ee24643b79a579c5dd8a4cf28 (DEFAULT_TABLE table=test-table [id=e4659a2eae5047b985c39bc826123331]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:27.960813 10089 tablet_service.cc:1467] Processing CreateTablet for tablet 26d1eb1ee24643b79a579c5dd8a4cf28 (DEFAULT_TABLE table=test-table [id=e4659a2eae5047b985c39bc826123331]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:27.961110 9941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26d1eb1ee24643b79a579c5dd8a4cf28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:27.961110 10089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26d1eb1ee24643b79a579c5dd8a4cf28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:27.961143 10187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:27.956612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41604 (local address 127.1.235.129:32795)
0809 23:19:27.956773 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:27.956777 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:27.957119 (+ 342us) server_negotiation.cc:407] Connection header received
0809 23:19:27.957165 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:27.957168 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:27.957182 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:27.957261 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:27.957350 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.958207 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.959535 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:27.960445 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:27.960505 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:27.960575 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:27.960754 (+ 179us) server_negotiation.cc:299] Negotiation successful
0809 23:19:27.960811 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":83,"threads_started":1}
I20260809 23:19:27.961897 9784 tablet_service.cc:1467] Processing CreateTablet for tablet 26d1eb1ee24643b79a579c5dd8a4cf28 (DEFAULT_TABLE table=test-table [id=e4659a2eae5047b985c39bc826123331]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:19:27.962241 9784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26d1eb1ee24643b79a579c5dd8a4cf28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:27.964532 10190 tablet_bootstrap.cc:492] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45: Bootstrap starting.
I20260809 23:19:27.964836 10191 tablet_bootstrap.cc:492] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363: Bootstrap starting.
I20260809 23:19:27.965175 10190 tablet_bootstrap.cc:654] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:27.965363 10191 tablet_bootstrap.cc:654] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:27.965528 10190 log.cc:824] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:27.965703 10191 log.cc:824] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:27.965843 10189 tablet_bootstrap.cc:492] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891: Bootstrap starting.
I20260809 23:19:27.966281 10190 tablet_bootstrap.cc:492] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45: No bootstrap required, opened a new log
I20260809 23:19:27.966378 10190 ts_tablet_manager.cc:1397] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:19:27.966606 10189 tablet_bootstrap.cc:654] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:27.966897 10189 log.cc:824] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:27.967554 10189 tablet_bootstrap.cc:492] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891: No bootstrap required, opened a new log
I20260809 23:19:27.967555 10191 tablet_bootstrap.cc:492] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363: No bootstrap required, opened a new log
I20260809 23:19:27.967612 10189 ts_tablet_manager.cc:1397] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:19:27.967612 10191 ts_tablet_manager.cc:1397] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260809 23:19:27.968339 10190 raft_consensus.cc:348] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8144f47baac64d2080c8bb6e16304891" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35349 } } peers { permanent_uuid: "9be6f411651c42d39f0d15858ec42a45" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 40061 } } peers { permanent_uuid: "bf963feece204c379c42d6add1d14363" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 32795 } }
I20260809 23:19:27.968500 10190 raft_consensus.cc:374] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:27.968540 10190 raft_consensus.cc:729] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9be6f411651c42d39f0d15858ec42a45, State: Initialized, Role: FOLLOWER
I20260809 23:19:27.968657 10190 consensus_queue.cc:260] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8144f47baac64d2080c8bb6e16304891" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35349 } } peers { permanent_uuid: "9be6f411651c42d39f0d15858ec42a45" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 40061 } } peers { permanent_uuid: "bf963feece204c379c42d6add1d14363" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 32795 } }
I20260809 23:19:27.968919 10190 ts_tablet_manager.cc:1428] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:19:27.968987 10164 heartbeater.cc:503] Master 127.1.235.190:44145 was elected leader, sending a full tablet report...
I20260809 23:19:27.969914 10191 raft_consensus.cc:348] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8144f47baac64d2080c8bb6e16304891" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35349 } } peers { permanent_uuid: "9be6f411651c42d39f0d15858ec42a45" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 40061 } } peers { permanent_uuid: "bf963feece204c379c42d6add1d14363" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 32795 } }
I20260809 23:19:27.969914 10189 raft_consensus.cc:348] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8144f47baac64d2080c8bb6e16304891" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35349 } } peers { permanent_uuid: "9be6f411651c42d39f0d15858ec42a45" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 40061 } } peers { permanent_uuid: "bf963feece204c379c42d6add1d14363" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 32795 } }
I20260809 23:19:27.970046 10191 raft_consensus.cc:374] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:27.970057 10189 raft_consensus.cc:374] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:27.970119 10189 raft_consensus.cc:729] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8144f47baac64d2080c8bb6e16304891, State: Initialized, Role: FOLLOWER
I20260809 23:19:27.970103 10191 raft_consensus.cc:729] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf963feece204c379c42d6add1d14363, State: Initialized, Role: FOLLOWER
I20260809 23:19:27.970213 10189 consensus_queue.cc:260] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8144f47baac64d2080c8bb6e16304891" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35349 } } peers { permanent_uuid: "9be6f411651c42d39f0d15858ec42a45" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 40061 } } peers { permanent_uuid: "bf963feece204c379c42d6add1d14363" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 32795 } }
I20260809 23:19:27.970227 10191 consensus_queue.cc:260] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8144f47baac64d2080c8bb6e16304891" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35349 } } peers { permanent_uuid: "9be6f411651c42d39f0d15858ec42a45" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 40061 } } peers { permanent_uuid: "bf963feece204c379c42d6add1d14363" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 32795 } }
I20260809 23:19:27.970429 10191 ts_tablet_manager.cc:1428] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:19:27.970429 10189 ts_tablet_manager.cc:1428] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:19:27.970563 9859 heartbeater.cc:503] Master 127.1.235.190:44145 was elected leader, sending a full tablet report...
I20260809 23:19:27.970752 10013 heartbeater.cc:503] Master 127.1.235.190:44145 was elected leader, sending a full tablet report...
I20260809 23:19:28.036252 10197 raft_consensus.cc:482] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:19:28.036365 10197 raft_consensus.cc:504] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8144f47baac64d2080c8bb6e16304891" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35349 } } peers { permanent_uuid: "9be6f411651c42d39f0d15858ec42a45" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 40061 } } peers { permanent_uuid: "bf963feece204c379c42d6add1d14363" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 32795 } }
I20260809 23:19:28.036770 10197 leader_election.cc:288] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9be6f411651c42d39f0d15858ec42a45 (127.1.235.131:40061), bf963feece204c379c42d6add1d14363 (127.1.235.129:32795)
W20260809 23:19:28.038853 10015 tablet.cc:2369] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:19:28.039831 10017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:28.036947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:32795 (local address 127.1.235.130:35271)
0809 23:19:28.036994 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:28.037003 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:28.037039 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:28.037201 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:28.037202 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:28.037203 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:28.037267 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:28.037268 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:28.038032 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:28.038032 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:28.038809 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:28.038812 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:28.039525 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:28.039526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:28.039579 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:28.039583 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:19:28.039687 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 23:19:28.039734 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":2}
I20260809 23:19:28.039848 10187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:28.037005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:35271 (local address 127.1.235.129:32795)
0809 23:19:28.037046 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:28.037048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:28.037059 (+ 11us) server_negotiation.cc:407] Connection header received
0809 23:19:28.037095 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:28.037095 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:28.037103 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:28.037165 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:28.037340 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:28.037959 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:28.038885 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:28.039438 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:28.039512 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:28.039520 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:28.039723 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 23:19:28.039757 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:19:28.039953 10019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:28.036897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:40061 (local address 127.1.235.130:43011)
0809 23:19:28.036966 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:28.036977 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:28.037018 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:28.037152 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:28.037154 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:28.037155 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:19:28.037269 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:28.037271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:28.037953 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:28.037954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:28.038848 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:28.038851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:28.039644 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:28.039645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:28.039742 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:28.039744 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:19:28.039807 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 23:19:28.039835 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":2}
I20260809 23:19:28.039994 10186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:28.036953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:43011 (local address 127.1.235.131:40061)
0809 23:19:28.036994 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:28.036996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:28.037008 (+ 12us) server_negotiation.cc:407] Connection header received
0809 23:19:28.037076 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:28.037076 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:28.037085 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:28.037132 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:19:28.037366 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:28.037886 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:28.038930 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:28.039557 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:28.039629 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:28.039634 (+ 5us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:28.039821 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 23:19:28.039856 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:19:28.040230 9806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26d1eb1ee24643b79a579c5dd8a4cf28" candidate_uuid: "8144f47baac64d2080c8bb6e16304891" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf963feece204c379c42d6add1d14363" is_pre_election: true
I20260809 23:19:28.040251 10112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26d1eb1ee24643b79a579c5dd8a4cf28" candidate_uuid: "8144f47baac64d2080c8bb6e16304891" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9be6f411651c42d39f0d15858ec42a45" is_pre_election: true
I20260809 23:19:28.040360 9806 raft_consensus.cc:2454] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8144f47baac64d2080c8bb6e16304891 in term 0.
I20260809 23:19:28.040366 10112 raft_consensus.cc:2454] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8144f47baac64d2080c8bb6e16304891 in term 0.
I20260809 23:19:28.040551 9889 leader_election.cc:302] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8144f47baac64d2080c8bb6e16304891, bf963feece204c379c42d6add1d14363; no voters:
I20260809 23:19:28.040655 10197 raft_consensus.cc:2781] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:19:28.040702 10197 raft_consensus.cc:482] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:19:28.040716 10197 raft_consensus.cc:3037] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:28.041404 10197 raft_consensus.cc:504] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8144f47baac64d2080c8bb6e16304891" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35349 } } peers { permanent_uuid: "9be6f411651c42d39f0d15858ec42a45" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 40061 } } peers { permanent_uuid: "bf963feece204c379c42d6add1d14363" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 32795 } }
I20260809 23:19:28.041539 10197 leader_election.cc:288] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [CANDIDATE]: Term 1 election: Requested vote from peers 9be6f411651c42d39f0d15858ec42a45 (127.1.235.131:40061), bf963feece204c379c42d6add1d14363 (127.1.235.129:32795)
I20260809 23:19:28.041682 9806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26d1eb1ee24643b79a579c5dd8a4cf28" candidate_uuid: "8144f47baac64d2080c8bb6e16304891" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf963feece204c379c42d6add1d14363"
I20260809 23:19:28.041687 10112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26d1eb1ee24643b79a579c5dd8a4cf28" candidate_uuid: "8144f47baac64d2080c8bb6e16304891" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9be6f411651c42d39f0d15858ec42a45"
I20260809 23:19:28.041756 9806 raft_consensus.cc:3037] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:28.041777 10112 raft_consensus.cc:3037] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:28.042430 9806 raft_consensus.cc:2454] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8144f47baac64d2080c8bb6e16304891 in term 1.
I20260809 23:19:28.042573 9889 leader_election.cc:302] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8144f47baac64d2080c8bb6e16304891, bf963feece204c379c42d6add1d14363; no voters:
I20260809 23:19:28.042609 10112 raft_consensus.cc:2454] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8144f47baac64d2080c8bb6e16304891 in term 1.
I20260809 23:19:28.042662 10197 raft_consensus.cc:2781] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:28.042824 10197 raft_consensus.cc:686] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [term 1 LEADER]: Becoming Leader. State: Replica: 8144f47baac64d2080c8bb6e16304891, State: Running, Role: LEADER
I20260809 23:19:28.042914 10197 consensus_queue.cc:237] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8144f47baac64d2080c8bb6e16304891" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35349 } } peers { permanent_uuid: "9be6f411651c42d39f0d15858ec42a45" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 40061 } } peers { permanent_uuid: "bf963feece204c379c42d6add1d14363" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 32795 } }
I20260809 23:19:28.043620 8768 catalog_manager.cc:5495] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8144f47baac64d2080c8bb6e16304891 (127.1.235.130). New cstate: current_term: 1 leader_uuid: "8144f47baac64d2080c8bb6e16304891" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8144f47baac64d2080c8bb6e16304891" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9be6f411651c42d39f0d15858ec42a45" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 40061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf963feece204c379c42d6add1d14363" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 32795 } health_report { overall_health: UNKNOWN } } }
I20260809 23:19:28.050992 10188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:28.049126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42162 (local address 127.1.235.130:35349)
0809 23:19:28.049162 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:28.049164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:28.049170 (+ 6us) server_negotiation.cc:407] Connection header received
0809 23:19:28.049240 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:28.049240 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:28.049253 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:28.049303 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:19:28.049386 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:28.049765 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:28.050391 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:28.050556 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:28.050606 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:28.050715 (+ 109us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:19:28.050811 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:19:28.050868 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:28.050902 (+ 34us) server_negotiation.cc:299] Negotiation successful
0809 23:19:28.050917 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 23:19:28.052474 10112 raft_consensus.cc:1261] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45 [term 1 FOLLOWER]: Refusing update from remote peer 8144f47baac64d2080c8bb6e16304891: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:28.052726 9806 raft_consensus.cc:1261] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363 [term 1 FOLLOWER]: Refusing update from remote peer 8144f47baac64d2080c8bb6e16304891: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:19:28.052784 10198 consensus_queue.cc:1035] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9be6f411651c42d39f0d15858ec42a45" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 40061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:28.053035 10198 consensus_queue.cc:1035] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf963feece204c379c42d6add1d14363" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 32795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:19:28.055255 10205 mvcc.cc:205] Tried to move back new op lower bound from 7316756758740643840 to 7316756758704242688. Current Snapshot: MvccSnapshot[applied={T|T < 7316756758740643840}]
I20260809 23:19:28.056136 10202 mvcc.cc:205] Tried to move back new op lower bound from 7316756758740643840 to 7316756758704242688. Current Snapshot: MvccSnapshot[applied={T|T < 7316756758740643840}]
I20260809 23:19:28.056147 10203 mvcc.cc:205] Tried to move back new op lower bound from 7316756758740643840 to 7316756758704242688. Current Snapshot: MvccSnapshot[applied={T|T < 7316756758740643840 or (T in {7316756758740643840})}]
I20260809 23:19:28.058058 8769 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:28.058127 8769 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46690:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:19:28.059149 8769 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 573e223d38144aab863d5ff5f1849722: Sending DeleteTablet for 3 replicas of tablet 26d1eb1ee24643b79a579c5dd8a4cf28
I20260809 23:19:28.059430 9784 tablet_service.cc:1514] Processing DeleteTablet for tablet 26d1eb1ee24643b79a579c5dd8a4cf28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:28 UTC) from {username='oryx', principal='oryx/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:41604
I20260809 23:19:28.059453 10089 tablet_service.cc:1514] Processing DeleteTablet for tablet 26d1eb1ee24643b79a579c5dd8a4cf28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:28 UTC) from {username='oryx', principal='oryx/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:40498
I20260809 23:19:28.059651 10216 tablet_replica.cc:330] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45: stopping tablet replica
I20260809 23:19:28.059742 10216 raft_consensus.cc:2229] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:28.059901 9941 tablet_service.cc:1514] Processing DeleteTablet for tablet 26d1eb1ee24643b79a579c5dd8a4cf28 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:19:28 UTC) from {username='oryx', principal='oryx/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:42158
I20260809 23:19:28.060184 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 8735
I20260809 23:19:28.062513 10217 tablet_replica.cc:330] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891: stopping tablet replica
I20260809 23:19:28.062638 10217 raft_consensus.cc:2229] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:19:28.062767 10217 raft_consensus.cc:2258] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:28.063198 10217 ts_tablet_manager.cc:1905] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:28.065012 10217 ts_tablet_manager.cc:1918] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:19:28.065088 10217 log.cc:1196] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/26d1eb1ee24643b79a579c5dd8a4cf28
I20260809 23:19:28.065326 10217 ts_tablet_manager.cc:1939] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 8144f47baac64d2080c8bb6e16304891: Deleting consensus metadata
I20260809 23:19:28.065884 10216 raft_consensus.cc:2258] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:28.066072 10215 tablet_replica.cc:330] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363: stopping tablet replica
I20260809 23:19:28.066162 10215 raft_consensus.cc:2229] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:19:28.066262 10215 raft_consensus.cc:2258] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:19:28.066686 10215 ts_tablet_manager.cc:1905] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:28.068481 10215 ts_tablet_manager.cc:1918] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:19:28.068562 10215 log.cc:1196] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-0/wal/wals/26d1eb1ee24643b79a579c5dd8a4cf28
I20260809 23:19:28.068799 10215 ts_tablet_manager.cc:1939] T 26d1eb1ee24643b79a579c5dd8a4cf28 P bf963feece204c379c42d6add1d14363: Deleting consensus metadata
I20260809 23:19:28.069741 10179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:28.060173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53294 (local address 127.1.235.188:42377)
0809 23:19:28.060209 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:28.060210 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:28.060217 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:19:28.060266 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:28.060267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:28.060277 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:28.060302 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:28.062442 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:28.062938 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:28.063995 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:28.064268 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:28.064329 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:28.066567 (+ 2238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:28.066568 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:28.066568 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:28.066575 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:28.068308 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:28.068789 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:28.068790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:28.068790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:28.068847 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:28.069083 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:28.069084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:28.069084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:28.069217 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:28.069288 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:28.069512 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 23:19:28.069612 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 23:19:28.070638 9732 connection.cc:535] server connection from 127.0.0.1:41604 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 23:19:28.071009 9887 connection.cc:535] server connection from 127.0.0.1:42158 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 23:19:28.071031 10216 ts_tablet_manager.cc:1905] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:19:28.072640 10216 ts_tablet_manager.cc:1918] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:19:28.072731 10216 log.cc:1196] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/26d1eb1ee24643b79a579c5dd8a4cf28
I20260809 23:19:28.073012 10216 ts_tablet_manager.cc:1939] T 26d1eb1ee24643b79a579c5dd8a4cf28 P 9be6f411651c42d39f0d15858ec42a45: Deleting consensus metadata
W20260809 23:19:28.073360 10038 connection.cc:441] server connection from 127.0.0.1:40498 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40498 (request call id 1) could send its response
I20260809 23:19:28.079170 10179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:28.072575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53302 (local address 127.1.235.188:42377)
0809 23:19:28.072826 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:28.072827 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:28.072855 (+ 28us) server_negotiation.cc:407] Connection header received
0809 23:19:28.072873 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:28.072874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:28.072883 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:28.072940 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:28.073989 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:28.074374 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:28.075157 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:28.075415 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:28.075476 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:28.076560 (+ 1084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:28.076561 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:28.076562 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:28.076567 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:28.078129 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:28.078477 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:28.078479 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:28.078479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:28.078544 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:28.078738 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:28.078739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:28.078739 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:28.078834 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:28.078922 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:28.079003 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 23:19:28.079069 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233}
I20260809 23:19:28.079985 10177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:28.073094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60078 (local address 127.1.235.189:42473)
0809 23:19:28.073139 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:28.073141 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:28.073971 (+ 830us) server_negotiation.cc:407] Connection header received
0809 23:19:28.074053 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:28.074054 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:28.074066 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:28.074100 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:28.074767 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:28.075314 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:28.076129 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:28.076409 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:28.076472 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:28.077638 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:28.077639 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:28.077639 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:28.077645 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:28.079052 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:28.079396 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:28.079397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:28.079397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:28.079445 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:28.079609 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:28.079610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:28.079610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:28.079706 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:28.079771 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:28.079880 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 23:19:28.079935 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:19:29.056631 10227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:29.056367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:59413)
0809 23:19:29.056503 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:29.056581 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":56,"threads_started":1}
I20260809 23:19:29.056674 10226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:29.056354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:46765)
0809 23:19:29.056547 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:29.056625 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":61,"threads_started":1}
I20260809 23:19:29.056631 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:29.056141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:50415)
0809 23:19:29.056495 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:29.056580 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":84,"threads_started":1}
W20260809 23:19:29.056958 10164 heartbeater.cc:644] Failed to heartbeat to 127.1.235.190:44145 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
W20260809 23:19:29.057029 9859 heartbeater.cc:644] Failed to heartbeat to 127.1.235.190:44145 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
W20260809 23:19:29.057168 10013 heartbeater.cc:644] Failed to heartbeat to 127.1.235.190:44145 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
I20260809 23:19:29.559739 10228 raft_consensus.cc:482] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 573e223d38144aab863d5ff5f1849722)
I20260809 23:19:29.559852 10228 raft_consensus.cc:504] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } }
I20260809 23:19:29.560040 10228 leader_election.cc:288] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145)
I20260809 23:19:29.560307 10231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:29.560146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:47184)
0809 23:19:29.560231 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:29.560274 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72,"thread_start_us":51,"threads_started":1}
W20260809 23:19:29.560415 9427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
I20260809 23:19:29.560748 10231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:29.560658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:47196)
0809 23:19:29.560707 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:29.560730 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 23:19:29.560824 9427 leader_election.cc:334] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145): Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
I20260809 23:19:29.560889 9427 leader_election.cc:302] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: e138e903b8e7464eaa33982beed4f8bd; no voters: 573e223d38144aab863d5ff5f1849722
I20260809 23:19:29.560984 10228 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:19:30.057554 10233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:30.057263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:58299)
0809 23:19:30.057452 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:30.057495 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":108,"threads_started":1}
I20260809 23:19:30.057838 10235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:30.057547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:57903)
0809 23:19:30.057732 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:30.057769 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":57,"threads_started":1}
I20260809 23:19:30.057958 10234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:30.057323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:56903)
0809 23:19:30.057763 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:30.057839 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":52,"threads_started":1}
I20260809 23:19:31.058516 10237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:31.058241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:50095)
0809 23:19:31.058411 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:31.058453 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":54,"threads_started":1}
I20260809 23:19:31.058609 10236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:31.058221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:45039)
0809 23:19:31.058545 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:31.058571 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":63,"threads_started":1}
I20260809 23:19:31.058609 10238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:31.058431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:38649)
0809 23:19:31.058519 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:31.058554 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72,"thread_start_us":47,"threads_started":1}
I20260809 23:19:31.591173 10239 raft_consensus.cc:482] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 573e223d38144aab863d5ff5f1849722)
I20260809 23:19:31.591292 10239 raft_consensus.cc:504] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } }
I20260809 23:19:31.591478 10239 leader_election.cc:288] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145)
I20260809 23:19:31.591825 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:31.591650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:47482)
0809 23:19:31.591750 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:31.591785 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76,"thread_start_us":54,"threads_started":1}
I20260809 23:19:31.592226 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:31.592134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:47498)
0809 23:19:31.592180 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:31.592206 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 23:19:31.592320 9427 leader_election.cc:334] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145): Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
I20260809 23:19:31.592391 9427 leader_election.cc:302] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: e138e903b8e7464eaa33982beed4f8bd; no voters: 573e223d38144aab863d5ff5f1849722
I20260809 23:19:31.592474 10239 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:19:32.059217 10246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:32.059059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:34689)
0809 23:19:32.059146 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:32.059175 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72,"thread_start_us":44,"threads_started":1}
I20260809 23:19:32.059219 10243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:32.058999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:50917)
0809 23:19:32.059138 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:32.059173 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":65,"threads_started":1}
I20260809 23:19:32.059219 10245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:32.058980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:44901)
0809 23:19:32.059138 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:32.059173 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":92,"threads_started":1}
I20260809 23:19:33.059875 10248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:33.059597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:40437)
0809 23:19:33.059752 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:33.059798 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":60,"threads_started":1}
I20260809 23:19:33.059871 10247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:33.059589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:56779)
0809 23:19:33.059747 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:33.059798 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":67,"threads_started":1}
I20260809 23:19:33.059927 10249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:33.059721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:56013)
0809 23:19:33.059854 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:33.059887 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":59,"threads_started":1}
I20260809 23:19:33.465987 10251 raft_consensus.cc:482] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 573e223d38144aab863d5ff5f1849722)
I20260809 23:19:33.466109 10251 raft_consensus.cc:504] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } }
I20260809 23:19:33.466274 10251 leader_election.cc:288] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145)
I20260809 23:19:33.466626 10252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:33.466433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:47702)
0809 23:19:33.466552 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:33.466590 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":68,"threads_started":1}
I20260809 23:19:33.466974 10252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:33.466905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:47708)
0809 23:19:33.466933 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:33.466957 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260809 23:19:33.467046 9427 leader_election.cc:334] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145): Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
I20260809 23:19:33.467096 9427 leader_election.cc:302] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: e138e903b8e7464eaa33982beed4f8bd; no voters: 573e223d38144aab863d5ff5f1849722
I20260809 23:19:33.467173 10251 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:19:34.060524 10254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:34.060237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:60425)
0809 23:19:34.060424 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:34.060463 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":65,"threads_started":1}
I20260809 23:19:34.060564 10256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:34.060361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:46183)
0809 23:19:34.060475 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:34.060506 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":51,"threads_started":1}
I20260809 23:19:34.060568 10255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:34.060272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:43199)
0809 23:19:34.060462 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:34.060503 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":57,"threads_started":1}
I20260809 23:19:35.061300 10258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:35.061108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:32791)
0809 23:19:35.061215 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:35.061249 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":52,"threads_started":1}
I20260809 23:19:35.061300 10259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:35.061107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:54637)
0809 23:19:35.061215 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:35.061249 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":50,"threads_started":1}
I20260809 23:19:35.061303 10257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:35.060974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:57999)
0809 23:19:35.061216 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:35.061252 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":63,"threads_started":1}
I20260809 23:19:36.062141 10262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:36.061911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:60099)
0809 23:19:36.062031 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:36.062071 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":59,"threads_started":1}
I20260809 23:19:36.062141 10260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:36.061792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:32989)
0809 23:19:36.062033 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:36.062077 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":92,"threads_started":1}
I20260809 23:19:36.062476 10261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:36.061769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:53779)
0809 23:19:36.062281 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:36.062315 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":182,"threads_started":1}
I20260809 23:19:36.206202 10263 raft_consensus.cc:482] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 573e223d38144aab863d5ff5f1849722)
I20260809 23:19:36.206281 10263 raft_consensus.cc:504] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } }
I20260809 23:19:36.206431 10263 leader_election.cc:288] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145)
I20260809 23:19:36.206715 10264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:36.206550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:57198)
0809 23:19:36.206648 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:36.206681 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":59,"threads_started":1}
W20260809 23:19:36.206785 9427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111) [suppressed 2 similar messages]
I20260809 23:19:36.207091 10264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:36.207011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:57208)
0809 23:19:36.207050 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:36.207074 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260809 23:19:36.207162 9427 leader_election.cc:334] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145): Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
I20260809 23:19:36.207221 9427 leader_election.cc:302] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: e138e903b8e7464eaa33982beed4f8bd; no voters: 573e223d38144aab863d5ff5f1849722
I20260809 23:19:36.207296 10263 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:19:37.063216 10267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:37.062839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:39853)
0809 23:19:37.063113 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:37.063156 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":87,"threads_started":1}
I20260809 23:19:37.063269 10268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:37.063041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:55597)
0809 23:19:37.063199 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:37.063226 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":91,"threads_started":1}
I20260809 23:19:37.063263 10266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:37.062840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:54493)
0809 23:19:37.063165 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:37.063210 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":90,"threads_started":1}
I20260809 23:19:38.063913 10270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:38.063702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:60309)
0809 23:19:38.063833 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:38.063862 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":70,"threads_started":1}
I20260809 23:19:38.063913 10269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:38.063699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:51227)
0809 23:19:38.063821 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:38.063862 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":66,"threads_started":1}
I20260809 23:19:38.063985 10271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:38.063795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:44049)
0809 23:19:38.063905 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:38.063939 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":46,"threads_started":1}
I20260809 23:19:39.064566 10273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:39.064334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:35609)
0809 23:19:39.064474 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:39.064510 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":68,"threads_started":1}
I20260809 23:19:39.064646 10272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:39.064332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:45687)
0809 23:19:39.064563 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:39.064603 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":63,"threads_started":1}
I20260809 23:19:39.064659 10274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:39.064497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:38657)
0809 23:19:39.064598 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:39.064624 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":42,"threads_started":1}
I20260809 23:19:40.065496 10277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:40.065202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:49615)
0809 23:19:40.065386 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:40.065432 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":65,"threads_started":1}
I20260809 23:19:40.065562 10276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:40.065173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:35257)
0809 23:19:40.065456 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:40.065501 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":75,"threads_started":1}
I20260809 23:19:40.065744 10278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:40.065440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:59991)
0809 23:19:40.065573 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:40.065604 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
I20260809 23:19:40.585239 10279 raft_consensus.cc:482] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 573e223d38144aab863d5ff5f1849722)
I20260809 23:19:40.585341 10279 raft_consensus.cc:504] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } }
I20260809 23:19:40.585526 10279 leader_election.cc:288] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145)
I20260809 23:19:40.585901 10280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:40.585676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:57508)
0809 23:19:40.585774 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:40.585849 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":53,"threads_started":1}
I20260809 23:19:40.586325 10280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:40.586233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:57516)
0809 23:19:40.586282 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:40.586307 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 23:19:40.586418 9427 leader_election.cc:334] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145): Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
I20260809 23:19:40.586476 9427 leader_election.cc:302] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: e138e903b8e7464eaa33982beed4f8bd; no voters: 573e223d38144aab863d5ff5f1849722
I20260809 23:19:40.586558 10279 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:19:41.066221 10282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:41.065994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:36981)
0809 23:19:41.066116 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:41.066159 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":66,"threads_started":1}
I20260809 23:19:41.066352 10283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:41.065994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:38965)
0809 23:19:41.066271 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:41.066307 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":66,"threads_started":1}
I20260809 23:19:41.066402 10284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:41.066149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:55159)
0809 23:19:41.066320 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:41.066356 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":52,"threads_started":1}
I20260809 23:19:42.067070 10285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:42.066622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:46599)
0809 23:19:42.066959 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:42.066999 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":64,"threads_started":1}
I20260809 23:19:42.067095 10288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:42.066757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:57193)
0809 23:19:42.067010 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:42.067045 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":57,"threads_started":1}
I20260809 23:19:42.067175 10289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:42.066906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:40407)
0809 23:19:42.067085 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:42.067132 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":69,"threads_started":1}
I20260809 23:19:43.067915 10291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:43.067646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:58293)
0809 23:19:43.067765 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:43.067832 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":54,"threads_started":1}
I20260809 23:19:43.068123 10290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:43.067629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:38519)
0809 23:19:43.068046 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:43.068085 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":70,"threads_started":1}
I20260809 23:19:43.068233 10292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:43.068022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:48603)
0809 23:19:43.068147 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:43.068182 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":47,"threads_started":1}
I20260809 23:19:44.068775 10295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:44.068571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:36153)
0809 23:19:44.068675 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:44.068719 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":45,"threads_started":1}
I20260809 23:19:44.068843 10296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:44.068659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:44157)
0809 23:19:44.068768 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:44.068802 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":41,"threads_started":1}
I20260809 23:19:44.068851 10294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:44.068476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:36907)
0809 23:19:44.068764 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:44.068800 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":68,"threads_started":1}
I20260809 23:19:45.069648 10297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:45.069340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:49295)
0809 23:19:45.069551 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:45.069600 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":75,"threads_started":1}
I20260809 23:19:45.069633 10299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:45.069433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:58137)
0809 23:19:45.069536 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:45.069576 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":47,"threads_started":1}
I20260809 23:19:45.069634 10298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:45.069377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:52847)
0809 23:19:45.069564 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:45.069598 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":56,"threads_started":1}
I20260809 23:19:46.070302 10300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:46.070033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:42083)
0809 23:19:46.070183 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:46.070240 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":70,"threads_started":1}
I20260809 23:19:46.070356 10303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:46.070154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:58175)
0809 23:19:46.070276 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:46.070308 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":48,"threads_started":1}
I20260809 23:19:46.070394 10302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:46.070138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:56739)
0809 23:19:46.070325 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:46.070354 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":51,"threads_started":1}
I20260809 23:19:47.071130 10305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:47.070752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:55017)
0809 23:19:47.071056 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:47.071087 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":79,"threads_started":1}
I20260809 23:19:47.071130 10304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:47.070752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:50477)
0809 23:19:47.070978 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:47.071076 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":65,"threads_started":1}
I20260809 23:19:47.071128 10306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:47.070844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:58739)
0809 23:19:47.071036 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:47.071074 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":80,"threads_started":1}
I20260809 23:19:48.072191 10307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:48.071641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:47057)
0809 23:19:48.072072 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:48.072113 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":82,"threads_started":1}
I20260809 23:19:48.072245 10310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:48.071914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:55941)
0809 23:19:48.072131 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:48.072190 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":58,"threads_started":1}
I20260809 23:19:48.072314 10308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:48.071846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:47615)
0809 23:19:48.072234 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:48.072268 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":60,"threads_started":1}
I20260809 23:19:48.077798 10311 raft_consensus.cc:482] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 573e223d38144aab863d5ff5f1849722)
I20260809 23:19:48.077932 10311 raft_consensus.cc:504] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } }
I20260809 23:19:48.078083 10311 leader_election.cc:288] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145)
I20260809 23:19:48.078380 10312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:48.078226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:36548)
0809 23:19:48.078321 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:48.078353 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":50,"threads_started":1}
W20260809 23:19:48.078465 9427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111) [suppressed 1 similar messages]
I20260809 23:19:48.078811 10312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:48.078711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:36562)
0809 23:19:48.078759 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:48.078790 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 23:19:48.078884 9427 leader_election.cc:334] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145): Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
I20260809 23:19:48.078930 9427 leader_election.cc:302] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: e138e903b8e7464eaa33982beed4f8bd; no voters: 573e223d38144aab863d5ff5f1849722
I20260809 23:19:48.079005 10311 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:19:49.073071 10315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:49.072603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:37533)
0809 23:19:49.072964 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:49.073008 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":63,"threads_started":1}
I20260809 23:19:49.073196 10316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:49.072901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:36797)
0809 23:19:49.073098 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:49.073142 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":56,"threads_started":1}
I20260809 23:19:49.073293 10318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:49.072937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:52805)
0809 23:19:49.073216 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:49.073248 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":64,"threads_started":1}
I20260809 23:19:50.074057 10320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:50.073602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:47487)
0809 23:19:50.073946 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:50.073991 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":74,"threads_started":1}
I20260809 23:19:50.074127 10322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:50.073803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:55957)
0809 23:19:50.074040 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:50.074080 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":59,"threads_started":1}
I20260809 23:19:50.074159 10324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:50.073891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:58617)
0809 23:19:50.074073 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:50.074119 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":53,"threads_started":1}
I20260809 23:19:50.385999 10325 raft_consensus.cc:482] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 573e223d38144aab863d5ff5f1849722)
I20260809 23:19:50.386122 10325 raft_consensus.cc:504] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } }
I20260809 23:19:50.386298 10325 leader_election.cc:288] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145)
I20260809 23:19:50.386734 10326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:50.386486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:36680)
0809 23:19:50.386627 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:50.386683 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":84,"threads_started":1}
I20260809 23:19:50.387130 10326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:50.387040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:36694)
0809 23:19:50.387085 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:50.387111 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260809 23:19:50.387215 9427 leader_election.cc:334] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145): Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
I20260809 23:19:50.387264 9427 leader_election.cc:302] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: e138e903b8e7464eaa33982beed4f8bd; no voters: 573e223d38144aab863d5ff5f1849722
I20260809 23:19:50.387364 10325 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:19:51.074717 10329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:51.074493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:39795)
0809 23:19:51.074621 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:51.074659 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":63,"threads_started":1}
I20260809 23:19:51.074916 10331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:51.074691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:52769)
0809 23:19:51.074839 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:51.074872 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":44,"threads_started":1}
I20260809 23:19:51.074997 10330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:51.074606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:56743)
0809 23:19:51.074921 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:51.074956 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":74,"threads_started":1}
I20260809 23:19:51.997328 10332 raft_consensus.cc:482] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 573e223d38144aab863d5ff5f1849722)
I20260809 23:19:51.997421 10332 raft_consensus.cc:504] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } }
I20260809 23:19:51.997541 10332 leader_election.cc:288] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145)
I20260809 23:19:51.997962 10333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:51.997725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:36774)
0809 23:19:51.997857 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:51.997921 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
I20260809 23:19:51.998400 10333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:51.998299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:36776)
0809 23:19:51.998349 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:51.998378 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 23:19:51.998486 9427 leader_election.cc:334] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145): Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
I20260809 23:19:51.998559 9427 leader_election.cc:302] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: e138e903b8e7464eaa33982beed4f8bd; no voters: 573e223d38144aab863d5ff5f1849722
I20260809 23:19:51.998677 10332 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:19:52.075700 10336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:52.075420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:54271)
0809 23:19:52.075599 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:52.075645 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":59,"threads_started":1}
I20260809 23:19:52.075937 10337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:52.075753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:42581)
0809 23:19:52.075855 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:52.075886 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":48,"threads_started":1}
I20260809 23:19:52.076133 10335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:52.075339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:42969)
0809 23:19:52.076034 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:52.076086 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":676,"thread_start_us":79,"threads_started":1}
I20260809 23:19:53.076663 10340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:53.076418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:48533)
0809 23:19:53.076561 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:53.076606 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":54,"threads_started":1}
I20260809 23:19:53.076735 10338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:53.076243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:45399)
0809 23:19:53.076645 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:53.076684 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":66,"threads_started":1}
I20260809 23:19:53.076819 10341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:53.076514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:46277)
0809 23:19:53.076745 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:53.076779 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":50,"threads_started":1}
I20260809 23:19:54.077505 10342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:54.077150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:34633)
0809 23:19:54.077403 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:54.077446 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":72,"threads_started":1}
I20260809 23:19:54.077560 10343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:54.077328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:54371)
0809 23:19:54.077461 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:54.077502 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":72,"threads_started":1}
I20260809 23:19:54.077868 10344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:54.077492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:47633)
0809 23:19:54.077763 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:54.077800 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":49,"threads_started":1}
I20260809 23:19:55.078362 10346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:55.078046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:51957)
0809 23:19:55.078249 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:55.078298 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":78,"threads_started":1}
I20260809 23:19:55.078435 10345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:55.077973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:57295)
0809 23:19:55.078343 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:55.078384 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":102,"threads_started":1}
I20260809 23:19:55.078764 10347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:55.078409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:57793)
0809 23:19:55.078683 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:55.078723 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":52,"threads_started":1}
I20260809 23:19:56.079250 10348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:56.078873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:38367)
0809 23:19:56.079157 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:56.079196 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":72,"threads_started":1}
I20260809 23:19:56.079306 10349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:56.079095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:59323)
0809 23:19:56.079226 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:56.079261 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":53,"threads_started":1}
I20260809 23:19:56.079511 10350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:56.079099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:60119)
0809 23:19:56.079434 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:56.079468 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":46,"threads_started":1}
I20260809 23:19:56.310493 10352 raft_consensus.cc:482] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 573e223d38144aab863d5ff5f1849722)
I20260809 23:19:56.310583 10352 raft_consensus.cc:504] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "573e223d38144aab863d5ff5f1849722" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44145 } } peers { permanent_uuid: "e138e903b8e7464eaa33982beed4f8bd" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 42473 } attrs { promote: false } } peers { permanent_uuid: "4bc6d5448a8446e8ae6d10b97de4ef8c" member_type: NON_VOTER last_known_addr { host: "127.1.235.188" port: 42377 } attrs { promote: true } }
I20260809 23:19:56.310680 10352 leader_election.cc:288] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145)
I20260809 23:19:56.310976 10353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:56.310813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:52712)
0809 23:19:56.310907 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:56.310941 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76,"thread_start_us":51,"threads_started":1}
W20260809 23:19:56.311059 9427 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111) [suppressed 2 similar messages]
I20260809 23:19:56.311395 10353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:56.311299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.0.0.1:52724)
0809 23:19:56.311346 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:56.311368 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260809 23:19:56.311463 9427 leader_election.cc:334] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 573e223d38144aab863d5ff5f1849722 (127.1.235.190:44145): Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
I20260809 23:19:56.311493 9427 leader_election.cc:302] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: e138e903b8e7464eaa33982beed4f8bd; no voters: 573e223d38144aab863d5ff5f1849722
I20260809 23:19:56.311565 10352 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e138e903b8e7464eaa33982beed4f8bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:19:57.080175 10355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:57.079694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:59389)
0809 23:19:57.080035 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:57.080093 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":72,"threads_started":1}
I20260809 23:19:57.080307 10357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:57.079993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:33069)
0809 23:19:57.080236 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:57.080268 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":86,"threads_started":1}
I20260809 23:19:57.080484 10356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:57.079902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:59875)
0809 23:19:57.080400 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:57.080440 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":48,"threads_started":1}
I20260809 23:19:58.081071 10358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:58.080705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.131:52981)
0809 23:19:58.080968 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:58.081011 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":60,"threads_started":1}
I20260809 23:19:58.081118 10360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:58.080927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.129:42329)
0809 23:19:58.081052 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:58.081076 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":43,"threads_started":1}
I20260809 23:19:58.081135 10359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:58.080909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44145 (local address 127.1.235.130:48229)
0809 23:19:58.081009 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:58.081042 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:44145: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":45,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:903: Failure
Failed
Bad status: Timed out: Could not connect to the cluster: ConnectToClusterRpc(addrs: 127.1.235.190:44145,127.1.235.189:42473,127.1.235.188:42377, num_attempts: 243) passed its deadline: Not found: no leader found: ConnectToClusterRpc(addrs: 127.1.235.190:44145,127.1.235.189:42473,127.1.235.188:42377, num_attempts: 1)
I20260809 23:19:58.241964 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 9618
I20260809 23:19:58.249424 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 9869
I20260809 23:19:58.257665 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 10020
I20260809 23:19:58.262971 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 9296
I20260809 23:19:58.268781 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 9507
2026-08-09T23:19:58Z chronyd exiting
I20260809 23:19:58.285864 1966 test_util.cc:175] -----------------------------------------------
I20260809 23:19:58.285908 1966 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786317539151495-1966-0
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (34632 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:19:58 dist-test-slave-6nmv krb5kdc[10363](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:19:58 dist-test-slave-6nmv krb5kdc[10363](info): set up 2 sockets
Aug 09 23:19:58 dist-test-slave-6nmv krb5kdc[10363](info): commencing operation
krb5kdc: starting...
W20260809 23:19:59.292778 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.006s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:19:59 dist-test-slave-6nmv krb5kdc[10363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:19:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:19:59Z Disabled control of system clock
WARNING: no policy specified for oryx/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.190.keytab.
Entry for principal oryx/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.190.keytab.
I20260809 23:19:59.398412 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:35329
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.190.keytab
--principal=oryx/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:35329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:59.474390 10376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:59.474627 10376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:59.474666 10376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:59.475819 10376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:19:59.475884 10376 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 23:19:59.475904 10376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:59.475922 10376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:59.475940 10376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:19:59.475960 10376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:19:59.477335 10376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:35329
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.190.keytab
--principal=oryx/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:35329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:59.477598 10376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:59.477828 10376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 23:19:59.482811 10376 server_base.cc:1034] running on GCE node
W20260809 23:19:59.482754 10385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:59.482770 10383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:59.482781 10381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:59.483248 10376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:59.483553 10376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:59.484712 10376 hybrid_clock.cc:648] HybridClock initialized: now 1786317599484702 us; error 39 us; skew 500 ppm
Aug 09 23:19:59 dist-test-slave-6nmv krb5kdc[10363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317599, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:59.487222 10376 init.cc:377] Logged in from keytab as oryx/127.1.235.190@KRBTEST.COM (short username oryx)
I20260809 23:19:59.487624 10376 webserver.cc:460] Webserver started at http://127.1.235.190:39437/ using document root <none> and password file <none>
I20260809 23:19:59.487843 10376 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:59.487906 10376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:59.488046 10376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:59.488969 10376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "b0d231077a7c41efb741fccae1136d19"
format_stamp: "Formatted at 2026-08-09 23:19:59 on dist-test-slave-6nmv"
server_key: "460bf18d10ee67b51715af8757a053ac"
server_key_iv: "8f7bcbe5fc5d1b19f1ebc6771c5c12e0"
server_key_version: "encryptionkey@0"
I20260809 23:19:59.489322 10376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "b0d231077a7c41efb741fccae1136d19"
format_stamp: "Formatted at 2026-08-09 23:19:59 on dist-test-slave-6nmv"
server_key: "460bf18d10ee67b51715af8757a053ac"
server_key_iv: "8f7bcbe5fc5d1b19f1ebc6771c5c12e0"
server_key_version: "encryptionkey@0"
I20260809 23:19:59.490793 10376 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:19:59.491495 10394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:59.491683 10376 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:19:59.491797 10376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "b0d231077a7c41efb741fccae1136d19"
format_stamp: "Formatted at 2026-08-09 23:19:59 on dist-test-slave-6nmv"
server_key: "460bf18d10ee67b51715af8757a053ac"
server_key_iv: "8f7bcbe5fc5d1b19f1ebc6771c5c12e0"
server_key_version: "encryptionkey@0"
I20260809 23:19:59.491875 10376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:59.526515 10376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:59.528246 10376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:59.528393 10376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:59.533167 10376 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:35329
I20260809 23:19:59.533215 10465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:35329 every 8 connection(s)
I20260809 23:19:59.533496 10376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:19:59.534214 10466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:19:59.536303 10466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19: Bootstrap starting.
I20260809 23:19:59.536863 10466 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19: Neither blocks nor log segments found. Creating new log.
I20260809 23:19:59.537158 10466 log.cc:824] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19: Log is configured to *not* fsync() on all Append() calls
I20260809 23:19:59.537768 10466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19: No bootstrap required, opened a new log
I20260809 23:19:59.539674 10466 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d231077a7c41efb741fccae1136d19" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35329 } }
I20260809 23:19:59.539825 10466 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:19:59.539876 10466 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0d231077a7c41efb741fccae1136d19, State: Initialized, Role: FOLLOWER
I20260809 23:19:59.540009 10466 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d231077a7c41efb741fccae1136d19" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35329 } }
I20260809 23:19:59.540086 10466 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:19:59.540128 10466 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:19:59.540175 10466 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:19:59.540696 10466 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d231077a7c41efb741fccae1136d19" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35329 } }
I20260809 23:19:59.540819 10466 leader_election.cc:302] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0d231077a7c41efb741fccae1136d19; no voters:
I20260809 23:19:59.540979 10466 leader_election.cc:288] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:19:59.541010 10469 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:19:59.541208 10469 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [term 1 LEADER]: Becoming Leader. State: Replica: b0d231077a7c41efb741fccae1136d19, State: Running, Role: LEADER
I20260809 23:19:59.541225 10466 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:19:59.541330 10469 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d231077a7c41efb741fccae1136d19" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35329 } }
I20260809 23:19:59.541731 10470 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0d231077a7c41efb741fccae1136d19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d231077a7c41efb741fccae1136d19" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35329 } } }
I20260809 23:19:59.541738 10471 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0d231077a7c41efb741fccae1136d19. Latest consensus state: current_term: 1 leader_uuid: "b0d231077a7c41efb741fccae1136d19" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0d231077a7c41efb741fccae1136d19" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35329 } } }
I20260809 23:19:59.541872 10470 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:59.541970 10471 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19 [sys.catalog]: This master's current role is: LEADER
I20260809 23:19:59.542332 10479 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:19:59.542936 10479 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:19:59.542971 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 10376
I20260809 23:19:59.543069 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:19:59.543298 1966 external_mini_cluster.cc:1428] Setting key 6c21dba73ac44d9f3d3f85ad7d8a7986
I20260809 23:19:59.544821 10479 catalog_manager.cc:1347] Generated new cluster ID: 10c1fa2cc36d40f3926ef55133ce1ec4
I20260809 23:19:59.544938 10479 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 23:19:59 dist-test-slave-6nmv krb5kdc[10363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317599, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM
I20260809 23:19:59.552595 10491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:59.543936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46102 (local address 127.1.235.190:35329)
0809 23:19:59.544104 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:59.544113 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:59.544146 (+ 33us) server_negotiation.cc:407] Connection header received
0809 23:19:59.544262 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:59.544268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:59.544322 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:59.544486 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:59.545136 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.546097 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.546777 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.547166 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.547287 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:59.549424 (+ 2137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:59.549428 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:59.549429 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:59.549438 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:59.551051 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:59.551444 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:59.551446 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:59.551447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:59.551535 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:59.551782 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:59.551783 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:59.551783 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:59.552008 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:59.552184 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:59.552250 (+ 66us) server_negotiation.cc:299] Negotiation successful
0809 23:19:59.552410 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":71,"threads_started":1}
I20260809 23:19:59.592494 10479 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:19:59.593222 10479 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:19:59.598141 10479 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19: Generated new TSK 0
I20260809 23:19:59.598300 10479 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.129.keytab.
Entry for principal oryx/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.129.keytab.
I20260809 23:19:59.631106 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:35329
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.129.keytab
--principal=oryx/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:59.709022 10495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:59.709211 10495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:59.709236 10495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:59.710346 10495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:59.710402 10495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:59.710422 10495 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 23:19:59.710439 10495 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:19:59.711951 10495 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.129.keytab
--principal=oryx/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.235.190:35329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:59.712198 10495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:59.712448 10495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:59.717264 10501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:59.717378 10503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:59.717437 10495 server_base.cc:1034] running on GCE node
W20260809 23:19:59.717264 10500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:59.717749 10495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:59.718041 10495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:59.719208 10495 hybrid_clock.cc:648] HybridClock initialized: now 1786317599719205 us; error 38 us; skew 500 ppm
Aug 09 23:19:59 dist-test-slave-6nmv krb5kdc[10363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317599, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:59.721529 10495 init.cc:377] Logged in from keytab as oryx/127.1.235.129@KRBTEST.COM (short username oryx)
I20260809 23:19:59.722002 10495 webserver.cc:460] Webserver started at http://127.1.235.129:35879/ using document root <none> and password file <none>
I20260809 23:19:59.722240 10495 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:59.722307 10495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:59.722469 10495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:59.723476 10495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "c067c1e31b7c4fd19544fa1d400045dc"
format_stamp: "Formatted at 2026-08-09 23:19:59 on dist-test-slave-6nmv"
server_key: "400a6129bd122ce040ca38a6a925063e"
server_key_iv: "7e0290141da77a02a76f6abe9d0b5a31"
server_key_version: "encryptionkey@0"
I20260809 23:19:59.723812 10495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "c067c1e31b7c4fd19544fa1d400045dc"
format_stamp: "Formatted at 2026-08-09 23:19:59 on dist-test-slave-6nmv"
server_key: "400a6129bd122ce040ca38a6a925063e"
server_key_iv: "7e0290141da77a02a76f6abe9d0b5a31"
server_key_version: "encryptionkey@0"
I20260809 23:19:59.725214 10495 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:19:59.726003 10511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:59.726159 10495 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:19:59.726250 10495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "c067c1e31b7c4fd19544fa1d400045dc"
format_stamp: "Formatted at 2026-08-09 23:19:59 on dist-test-slave-6nmv"
server_key: "400a6129bd122ce040ca38a6a925063e"
server_key_iv: "7e0290141da77a02a76f6abe9d0b5a31"
server_key_version: "encryptionkey@0"
I20260809 23:19:59.726325 10495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:59.736720 10495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:59.738365 10495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:59.738518 10495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:59.738952 10495 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:59.739012 10495 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:59.739074 10495 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:59.739099 10495 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:59.746042 10495 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:37415
I20260809 23:19:59.746078 10642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:37415 every 8 connection(s)
Aug 09 23:19:59 dist-test-slave-6nmv krb5kdc[10363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317599, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM
I20260809 23:19:59.746440 10495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:19:59.749346 10491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:59.739453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:57887 (local address 127.1.235.190:35329)
0809 23:19:59.739527 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:59.739530 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:59.739686 (+ 156us) server_negotiation.cc:407] Connection header received
0809 23:19:59.740183 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:59.740185 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:59.740201 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:59.740253 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:59.741204 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.742018 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.743467 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.743796 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.743914 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:59.746737 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:59.746739 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:59.746739 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:59.746747 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:59.748248 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:59.748641 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:59.748641 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:59.748642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:59.748690 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:59.748903 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:59.748904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:59.748904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:59.748997 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:59.749045 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:59.749233 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 23:19:59.749288 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 23:19:59.749500 10520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:59.739413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:35329 (local address 127.1.235.129:57887)
0809 23:19:59.739583 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:59.739617 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:59.740059 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:59.740357 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:59.740362 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:59.740805 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:59.741094 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:59.741101 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.742110 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.742111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:59.743344 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:59.743347 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.743940 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.743941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:59.744069 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:59.744616 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:59.744626 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:59.746627 (+ 2001us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:59.748320 (+ 1693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:59.748327 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:59.748328 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:59.748561 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:59.748743 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:59.748743 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:59.748743 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:59.748832 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:59.749048 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:59.749051 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:59.749149 (+ 98us) client_negotiation.cc:769] Sending connection context
0809 23:19:59.749221 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 23:19:59.749332 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":88,"threads_started":1}
I20260809 23:19:59.750017 10643 heartbeater.cc:347] Connected to a master server at 127.1.235.190:35329
I20260809 23:19:59.750123 10643 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:59.750298 10643 heartbeater.cc:511] Master 127.1.235.190:35329 requested a full tablet report, sending...
I20260809 23:19:59.750867 10412 ts_manager.cc:194] Registered new tserver with Master: c067c1e31b7c4fd19544fa1d400045dc (127.1.235.129:37415)
I20260809 23:19:59.751505 10412 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:57887
I20260809 23:19:59.756193 10649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:59.751020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:35329 (local address 127.1.235.129:45455)
0809 23:19:59.751205 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:59.751213 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:59.751281 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:59.751421 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:59.751422 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:59.751581 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:59.751679 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:59.751681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.752537 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.752537 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:59.753061 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:59.753063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.753339 (+ 276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.753339 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:59.753395 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:59.753712 (+ 317us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:59.753715 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:59.754092 (+ 377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:59.755530 (+ 1438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:59.755531 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:59.755531 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:59.755667 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:59.755834 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:59.755835 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:59.755835 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:59.755872 (+ 37us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:59.756007 (+ 135us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:59.756007 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:59.756043 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 23:19:59.756078 (+ 35us) client_negotiation.cc:240] Negotiation successful
0809 23:19:59.756138 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":85,"threads_started":1}
I20260809 23:19:59.756196 10491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:59.751111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:45455 (local address 127.1.235.190:35329)
0809 23:19:59.751148 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:59.751150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:59.751268 (+ 118us) server_negotiation.cc:407] Connection header received
0809 23:19:59.751335 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:59.751336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:59.751346 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:59.751417 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:59.751781 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.752445 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.753124 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.753283 (+ 159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.753326 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:59.754162 (+ 836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:59.754163 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:59.754164 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:59.754169 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:59.755460 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:59.755755 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:59.755756 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:59.755756 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:59.755799 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:59.755907 (+ 108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:59.755907 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:59.755907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:59.755978 (+ 71us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:59.756016 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:59.756100 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 23:19:59.756150 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 23:19:59.756484 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 10495
I20260809 23:19:59.756592 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:19:59.756776 1966 external_mini_cluster.cc:1428] Setting key 6a204b03973806ca6ae0128c830f2c14
WARNING: no policy specified for oryx/127.1.235.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.130.keytab.
Entry for principal oryx/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.130.keytab.
I20260809 23:19:59.780315 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:35329
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.130.keytab
--principal=oryx/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:19:59.857779 10653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:19:59.857985 10653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:19:59.858006 10653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:19:59.859057 10653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:19:59.859097 10653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:19:59.859117 10653 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 23:19:59.859133 10653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:19:59.860562 10653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.130.keytab
--principal=oryx/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.235.190:35329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:19:59.860746 10653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:19:59.860910 10653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:19:59.866169 10659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:19:59.866182 10661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:59.866313 10653 server_base.cc:1034] running on GCE node
W20260809 23:19:59.866194 10658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:19:59.866549 10653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:19:59.866801 10653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:19:59.867976 10653 hybrid_clock.cc:648] HybridClock initialized: now 1786317599867959 us; error 27 us; skew 500 ppm
Aug 09 23:19:59 dist-test-slave-6nmv krb5kdc[10363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317599, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:19:59.870555 10653 init.cc:377] Logged in from keytab as oryx/127.1.235.130@KRBTEST.COM (short username oryx)
I20260809 23:19:59.870946 10653 webserver.cc:460] Webserver started at http://127.1.235.130:33709/ using document root <none> and password file <none>
I20260809 23:19:59.871124 10653 fs_manager.cc:359] Metadata directory not provided
I20260809 23:19:59.871167 10653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:19:59.871261 10653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:19:59.872288 10653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "3b204b786cbd45f0a263dc1d06c0577d"
format_stamp: "Formatted at 2026-08-09 23:19:59 on dist-test-slave-6nmv"
server_key: "5e55cad6a8376e37b8127ea91aafa6f0"
server_key_iv: "0e7f77159c4835ae33488de061b3a132"
server_key_version: "encryptionkey@0"
I20260809 23:19:59.872689 10653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "3b204b786cbd45f0a263dc1d06c0577d"
format_stamp: "Formatted at 2026-08-09 23:19:59 on dist-test-slave-6nmv"
server_key: "5e55cad6a8376e37b8127ea91aafa6f0"
server_key_iv: "0e7f77159c4835ae33488de061b3a132"
server_key_version: "encryptionkey@0"
I20260809 23:19:59.874171 10653 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:19:59.874904 10668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:59.875109 10653 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:19:59.875193 10653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "3b204b786cbd45f0a263dc1d06c0577d"
format_stamp: "Formatted at 2026-08-09 23:19:59 on dist-test-slave-6nmv"
server_key: "5e55cad6a8376e37b8127ea91aafa6f0"
server_key_iv: "0e7f77159c4835ae33488de061b3a132"
server_key_version: "encryptionkey@0"
I20260809 23:19:59.875242 10653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:19:59.891062 10653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:19:59.892830 10653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:19:59.892946 10653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:19:59.893358 10653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:19:59.893391 10653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:19:59.893415 10653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:19:59.893453 10653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 23:19:59 dist-test-slave-6nmv krb5kdc[10363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317599, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM
I20260809 23:19:59.900256 10653 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:46781
I20260809 23:19:59.900305 10800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:46781 every 8 connection(s)
I20260809 23:19:59.900652 10653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:19:59.902886 10491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:59.893899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:45933 (local address 127.1.235.190:35329)
0809 23:19:59.893950 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:59.893953 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:59.894183 (+ 230us) server_negotiation.cc:407] Connection header received
0809 23:19:59.894692 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:59.894694 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:59.894709 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:59.894787 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:59.895650 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.896395 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.897878 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.898211 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.898300 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:59.900477 (+ 2177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:59.900479 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:59.900479 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:59.900487 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:59.901958 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:59.902267 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:59.902268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:59.902268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:59.902313 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:59.902472 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:59.902472 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:59.902472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:59.902558 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:59.902610 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:59.902782 (+ 172us) server_negotiation.cc:299] Negotiation successful
0809 23:19:59.902832 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:19:59.903100 10679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:59.893872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:35329 (local address 127.1.235.130:45933)
0809 23:19:59.894037 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:59.894075 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:59.894583 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:59.894907 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:59.894911 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:59.895295 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:59.895551 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:59.895558 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.896518 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.896519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:59.897757 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:59.897760 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.898315 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.898316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:59.898456 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:59.898898 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:59.898934 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:59.900381 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:59.902018 (+ 1637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:59.902024 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:59.902025 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:59.902209 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:59.902349 (+ 140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:59.902349 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:59.902349 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:59.902429 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:59.902609 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:59.902613 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:59.902703 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 23:19:59.902770 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 23:19:59.902866 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":98,"threads_started":1}
I20260809 23:19:59.903596 10801 heartbeater.cc:347] Connected to a master server at 127.1.235.190:35329
I20260809 23:19:59.903672 10801 heartbeater.cc:464] Registering TS with master...
I20260809 23:19:59.903851 10801 heartbeater.cc:511] Master 127.1.235.190:35329 requested a full tablet report, sending...
I20260809 23:19:59.904285 10412 ts_manager.cc:194] Registered new tserver with Master: 3b204b786cbd45f0a263dc1d06c0577d (127.1.235.130:46781)
I20260809 23:19:59.904769 10412 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:45933
I20260809 23:19:59.904978 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 10653
I20260809 23:19:59.905126 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:19:59.905335 1966 external_mini_cluster.cc:1428] Setting key 747fe0fc821d441d9238548330858cda
I20260809 23:19:59.910274 10491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:59.904700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:54579 (local address 127.1.235.190:35329)
0809 23:19:59.904735 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 23:19:59.904737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:19:59.904856 (+ 119us) server_negotiation.cc:407] Connection header received
0809 23:19:59.904927 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:19:59.904927 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:19:59.904937 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:19:59.904986 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:19:59.905323 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.905711 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.906611 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.906792 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.906839 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:59.907741 (+ 902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:19:59.907742 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:19:59.907743 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:19:59.907750 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:19:59.909042 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:59.909418 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:59.909418 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:59.909419 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:59.909466 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:19:59.909734 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:19:59.909734 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:19:59.909735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:19:59.909923 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:19:59.909975 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 23:19:59.910157 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 23:19:59.910208 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 23:19:59.910386 10807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:19:59.904632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:35329 (local address 127.1.235.130:54579)
0809 23:19:59.904787 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 23:19:59.904801 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 23:19:59.904869 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:19:59.904997 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:19:59.904998 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:19:59.905208 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:19:59.905268 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:59.905269 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.905813 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.905813 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:59.906525 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:19:59.906528 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:19:59.906870 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:19:59.906871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:19:59.906940 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:19:59.907270 (+ 330us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:19:59.907275 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:19:59.907637 (+ 362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:19:59.909127 (+ 1490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:59.909128 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:59.909128 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:59.909342 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:59.909526 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:19:59.909527 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:19:59.909527 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:19:59.909669 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:19:59.909986 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:19:59.909987 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:19:59.910039 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 23:19:59.910133 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 23:19:59.910232 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":76,"threads_started":1}
WARNING: no policy specified for oryx/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.131.keytab.
Entry for principal oryx/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.131.keytab.
I20260809 23:19:59.928736 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:35329
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.131.keytab
--principal=oryx/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:20:00.004192 10810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:00.004470 10810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:00.004514 10810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:00.005692 10810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:00.005735 10810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:00.005756 10810 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 23:20:00.005774 10810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:20:00.007347 10810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.131.keytab
--principal=oryx/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.1.235.190:35329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10810
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:00.007619 10810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:00.007871 10810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:00.013763 10816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:00.013763 10821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:00.013773 10817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:00.014031 10810 server_base.cc:1034] running on GCE node
I20260809 23:20:00.014331 10810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:00.014598 10810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:00.015740 10810 hybrid_clock.cc:648] HybridClock initialized: now 1786317600015716 us; error 44 us; skew 500 ppm
Aug 09 23:20:00 dist-test-slave-6nmv krb5kdc[10363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317600, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:20:00.018532 10810 init.cc:377] Logged in from keytab as oryx/127.1.235.131@KRBTEST.COM (short username oryx)
I20260809 23:20:00.018934 10810 webserver.cc:460] Webserver started at http://127.1.235.131:43203/ using document root <none> and password file <none>
I20260809 23:20:00.019119 10810 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:00.019158 10810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:00.019250 10810 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:20:00.020260 10810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "286c7e3876d449cc82a589d1cd8ce568"
format_stamp: "Formatted at 2026-08-09 23:20:00 on dist-test-slave-6nmv"
server_key: "8b91a5a7b718536715bc83abfe76b412"
server_key_iv: "8d9e96e826e6bfc41922341211be0e85"
server_key_version: "encryptionkey@0"
I20260809 23:20:00.020637 10810 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "286c7e3876d449cc82a589d1cd8ce568"
format_stamp: "Formatted at 2026-08-09 23:20:00 on dist-test-slave-6nmv"
server_key: "8b91a5a7b718536715bc83abfe76b412"
server_key_iv: "8d9e96e826e6bfc41922341211be0e85"
server_key_version: "encryptionkey@0"
I20260809 23:20:00.022090 10810 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:20:00.022984 10829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:00.023186 10810 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:00.023284 10810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "286c7e3876d449cc82a589d1cd8ce568"
format_stamp: "Formatted at 2026-08-09 23:20:00 on dist-test-slave-6nmv"
server_key: "8b91a5a7b718536715bc83abfe76b412"
server_key_iv: "8d9e96e826e6bfc41922341211be0e85"
server_key_version: "encryptionkey@0"
I20260809 23:20:00.023358 10810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:00.035897 10810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:00.038264 10810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:00.038419 10810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:00.038964 10810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:20:00.039027 10810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:00.039075 10810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:20:00.039103 10810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 23:20:00 dist-test-slave-6nmv krb5kdc[10363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317600, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM
I20260809 23:20:00.046627 10810 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:42325
I20260809 23:20:00.046710 10959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:42325 every 8 connection(s)
I20260809 23:20:00.047051 10810 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:20:00.049582 10491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.039634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:39839 (local address 127.1.235.190:35329)
0809 23:20:00.039682 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.039683 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.039906 (+ 223us) server_negotiation.cc:407] Connection header received
0809 23:20:00.040483 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.040485 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.040503 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.040580 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:00.041464 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.042400 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.043711 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.044055 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.044130 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.046799 (+ 2669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:00.046800 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:00.046801 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:20:00.046808 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:00.048350 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:00.048785 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:00.048785 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:00.048786 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:00.048839 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:00.049043 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:00.049044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:00.049044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:00.049147 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:00.049198 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.049442 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.049517 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:20:00.049772 10839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.039636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:35329 (local address 127.1.235.131:39839)
0809 23:20:00.039785 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:00.039819 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:00.040338 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:00.040694 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:00.040699 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:00.041101 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:00.041376 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.041383 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.042518 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.042519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.043604 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.043607 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.044176 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.044177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.044306 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.045243 (+ 937us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:00.045250 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:00.046710 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:20:00.048474 (+ 1764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:00.048481 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:00.048483 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:00.048712 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:00.048883 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:00.048883 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:00.048883 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:00.048989 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:00.049206 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:20:00.049211 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:20:00.049321 (+ 110us) client_negotiation.cc:769] Sending connection context
0809 23:20:00.049412 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 23:20:00.049533 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":85,"threads_started":1}
I20260809 23:20:00.050346 10960 heartbeater.cc:347] Connected to a master server at 127.1.235.190:35329
I20260809 23:20:00.050438 10960 heartbeater.cc:464] Registering TS with master...
I20260809 23:20:00.050638 10960 heartbeater.cc:511] Master 127.1.235.190:35329 requested a full tablet report, sending...
I20260809 23:20:00.051082 10412 ts_manager.cc:194] Registered new tserver with Master: 286c7e3876d449cc82a589d1cd8ce568 (127.1.235.131:42325)
I20260809 23:20:00.051505 10412 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:39839
I20260809 23:20:00.053009 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 10810
I20260809 23:20:00.053125 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:20:00.053303 1966 external_mini_cluster.cc:1428] Setting key a1bb8f8d9d32794d3f96a981d45c9e38
I20260809 23:20:00.054215 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:20:00.059408 10968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.051383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:35329 (local address 127.1.235.131:54133)
0809 23:20:00.051553 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:00.051566 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:00.051649 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:00.051800 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:00.051801 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:00.051987 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:00.052039 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.052041 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.052755 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.052756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.053347 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.053349 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.053888 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.053889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.053979 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.056186 (+ 2207us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:00.056190 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:00.056469 (+ 279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:20:00.058303 (+ 1834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:00.058304 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:00.058304 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:00.058568 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:00.058804 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:00.058805 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:00.058805 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:00.058873 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:00.059167 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:20:00.059168 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:20:00.059205 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 23:20:00.059256 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 23:20:00.059335 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":92,"threads_started":1}
I20260809 23:20:00.059489 10491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.051519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:54133 (local address 127.1.235.190:35329)
0809 23:20:00.051572 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.051574 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.051633 (+ 59us) server_negotiation.cc:407] Connection header received
0809 23:20:00.051713 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.051714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.051724 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.051795 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:00.052128 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.052649 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.053462 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.053749 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.053861 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.056559 (+ 2698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:00.056561 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:00.056561 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:20:00.056570 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:00.058211 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:00.058656 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:00.058658 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:00.058658 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:00.058724 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:00.058949 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:00.058950 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:00.058950 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:00.059099 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:00.059174 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.059285 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.059364 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
Aug 09 23:20:00 dist-test-slave-6nmv krb5kdc[10363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317600, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 23:20:00 dist-test-slave-6nmv krb5kdc[10363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:00 dist-test-slave-6nmv krb5kdc[10363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 23:20:00.076722 10491 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:00.071309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46104 (local address 127.1.235.190:35329)
0809 23:20:00.071361 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.071363 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.071389 (+ 26us) server_negotiation.cc:407] Connection header received
0809 23:20:00.071482 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.071483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.071492 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.071563 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:00.072145 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.072631 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.073376 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.073578 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.073653 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.076623 (+ 2970us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46104: BlockingRecv error: recv got EOF from 127.0.0.1:46104 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 09 23:20:00 dist-test-slave-6nmv krb5kdc[10363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317600, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM
I20260809 23:20:00.084367 10491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.077653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46118 (local address 127.1.235.190:35329)
0809 23:20:00.077700 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.077702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.077858 (+ 156us) server_negotiation.cc:407] Connection header received
0809 23:20:00.077936 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.077936 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.077944 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.077985 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:00.078441 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.078962 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.079641 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.079817 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.079873 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.082079 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:00.082080 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:00.082080 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:20:00.082086 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:00.083318 (+ 1232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:00.083655 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:00.083656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:00.083656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:00.083709 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:00.083894 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:00.083894 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:00.083894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:00.084006 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:00.084082 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.084244 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.084304 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260809 23:20:00.086339 10412 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46118:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:20:00.088122 10412 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:20:00.094640 10986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.090641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59070 (local address 127.1.235.131:42325)
0809 23:20:00.090817 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.090822 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.090832 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:20:00.090876 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.090877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.090889 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.090958 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:20:00.091155 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.092020 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.093448 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.094183 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.094308 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.094393 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.094484 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.094530 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":74,"threads_started":1}
I20260809 23:20:00.094650 10984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.090395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:37415 (local address 127.0.0.1:41878)
0809 23:20:00.090656 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:00.090666 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:00.090708 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:00.091052 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:00.091053 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:00.091056 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:20:00.091116 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.091118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.092397 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.092398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.093467 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.093469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.094382 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.094394 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.094457 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.094461 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:20:00.094493 (+ 32us) client_negotiation.cc:240] Negotiation successful
0809 23:20:00.094552 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":2,"thread_start_us":62,"threads_started":1}
I20260809 23:20:00.094633 10983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.090403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:42325 (local address 127.0.0.1:59070)
0809 23:20:00.090763 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:00.090772 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:00.090808 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:00.090986 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:00.090988 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:00.090991 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:20:00.091056 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.091058 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.092110 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.092111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.093353 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.093356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.094279 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.094280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.094374 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.094393 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 23:20:00.094470 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 23:20:00.094547 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"mutex_wait_us":43,"thread_start_us":48,"threads_started":1}
I20260809 23:20:00.094949 10987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.090659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41878 (local address 127.1.235.129:37415)
0809 23:20:00.090856 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.090861 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.090870 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:20:00.090907 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.090909 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.090931 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.091048 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:20:00.091264 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.092310 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.093536 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.094278 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.094693 (+ 415us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.094781 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.094808 (+ 27us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.094845 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":79,"threads_started":1}
I20260809 23:20:00.095176 10982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.090392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:46781 (local address 127.0.0.1:34390)
0809 23:20:00.090559 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:00.090597 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:00.090663 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:00.091454 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:00.091454 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:00.091457 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:20:00.091498 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.091499 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.092667 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.092667 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.093721 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.093724 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.094952 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.094954 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.095017 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.095020 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:20:00.095075 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 23:20:00.095119 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":73,"threads_started":1}
I20260809 23:20:00.095465 10985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.090499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34390 (local address 127.1.235.130:46781)
0809 23:20:00.091231 (+ 732us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.091235 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.091245 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:20:00.091280 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.091282 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.091297 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.091368 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:20:00.091583 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.092576 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.093836 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.094647 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.094833 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.094923 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.095323 (+ 400us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.095363 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":688,"thread_start_us":78,"threads_started":1}
I20260809 23:20:00.095667 10568 tablet_service.cc:1467] Processing CreateTablet for tablet b20cf4b3d51a479390b494efbfb55108 (DEFAULT_TABLE table=test-table [id=20ae6bd1ef8d4c90b3c0b5f9267f266e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:20:00.095992 10568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b20cf4b3d51a479390b494efbfb55108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:00.095963 10728 tablet_service.cc:1467] Processing CreateTablet for tablet b20cf4b3d51a479390b494efbfb55108 (DEFAULT_TABLE table=test-table [id=20ae6bd1ef8d4c90b3c0b5f9267f266e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:20:00.096230 10728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b20cf4b3d51a479390b494efbfb55108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:00.098326 10881 tablet_service.cc:1467] Processing CreateTablet for tablet b20cf4b3d51a479390b494efbfb55108 (DEFAULT_TABLE table=test-table [id=20ae6bd1ef8d4c90b3c0b5f9267f266e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:20:00.098685 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b20cf4b3d51a479390b494efbfb55108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:00.099434 10989 tablet_bootstrap.cc:492] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d: Bootstrap starting.
I20260809 23:20:00.100097 10989 tablet_bootstrap.cc:654] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:00.100335 10989 log.cc:824] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d: Log is configured to *not* fsync() on all Append() calls
I20260809 23:20:00.100652 10988 tablet_bootstrap.cc:492] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc: Bootstrap starting.
I20260809 23:20:00.101073 10989 tablet_bootstrap.cc:492] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d: No bootstrap required, opened a new log
I20260809 23:20:00.101131 10989 ts_tablet_manager.cc:1397] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:20:00.101275 10988 tablet_bootstrap.cc:654] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:00.101553 10991 tablet_bootstrap.cc:492] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568: Bootstrap starting.
I20260809 23:20:00.101763 10988 log.cc:824] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc: Log is configured to *not* fsync() on all Append() calls
I20260809 23:20:00.102192 10991 tablet_bootstrap.cc:654] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:00.102521 10991 log.cc:824] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568: Log is configured to *not* fsync() on all Append() calls
I20260809 23:20:00.102697 10988 tablet_bootstrap.cc:492] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc: No bootstrap required, opened a new log
I20260809 23:20:00.102820 10988 ts_tablet_manager.cc:1397] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:20:00.103276 10991 tablet_bootstrap.cc:492] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568: No bootstrap required, opened a new log
I20260809 23:20:00.103369 10991 ts_tablet_manager.cc:1397] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:20:00.103516 10989 raft_consensus.cc:348] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.103704 10989 raft_consensus.cc:374] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:00.103775 10989 raft_consensus.cc:729] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b204b786cbd45f0a263dc1d06c0577d, State: Initialized, Role: FOLLOWER
I20260809 23:20:00.103901 10989 consensus_queue.cc:260] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.104172 10989 ts_tablet_manager.cc:1428] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:20:00.104197 10801 heartbeater.cc:503] Master 127.1.235.190:35329 was elected leader, sending a full tablet report...
I20260809 23:20:00.104904 10988 raft_consensus.cc:348] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.105073 10988 raft_consensus.cc:374] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:00.105150 10988 raft_consensus.cc:729] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c067c1e31b7c4fd19544fa1d400045dc, State: Initialized, Role: FOLLOWER
I20260809 23:20:00.105268 10988 consensus_queue.cc:260] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.105552 10988 ts_tablet_manager.cc:1428] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:20:00.105603 10643 heartbeater.cc:503] Master 127.1.235.190:35329 was elected leader, sending a full tablet report...
I20260809 23:20:00.105537 10991 raft_consensus.cc:348] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.105713 10991 raft_consensus.cc:374] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:00.105775 10991 raft_consensus.cc:729] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 286c7e3876d449cc82a589d1cd8ce568, State: Initialized, Role: FOLLOWER
I20260809 23:20:00.105912 10991 consensus_queue.cc:260] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.106174 10991 ts_tablet_manager.cc:1428] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:20:00.106199 10960 heartbeater.cc:503] Master 127.1.235.190:35329 was elected leader, sending a full tablet report...
I20260809 23:20:00.145751 10995 raft_consensus.cc:482] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:20:00.145874 10995 raft_consensus.cc:504] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.146170 10995 leader_election.cc:288] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b204b786cbd45f0a263dc1d06c0577d (127.1.235.130:46781), 286c7e3876d449cc82a589d1cd8ce568 (127.1.235.131:42325)
I20260809 23:20:00.149133 10520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.146359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:46781 (local address 127.1.235.129:35297)
0809 23:20:00.146423 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:00.146437 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:00.146491 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:00.146664 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:00.146665 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:00.146667 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:20:00.146737 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.146739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.147379 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.147380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.148125 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.148127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.148879 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.148880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.148971 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.148975 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:20:00.149015 (+ 40us) client_negotiation.cc:240] Negotiation successful
0809 23:20:00.149045 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260809 23:20:00.149163 10985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.146481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:35297 (local address 127.1.235.130:46781)
0809 23:20:00.146526 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.146528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.146536 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:20:00.146563 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.146563 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.146572 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.146659 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:20:00.146824 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.147294 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.148228 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.148800 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.148864 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.148873 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.149041 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.149088 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 23:20:00.149464 10986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.146478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:43369 (local address 127.1.235.131:42325)
0809 23:20:00.146523 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.146526 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.146690 (+ 164us) server_negotiation.cc:407] Connection header received
0809 23:20:00.146751 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.146752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.146761 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.146830 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:20:00.146991 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.147459 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.148500 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.149049 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.149125 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.149133 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.149320 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.149369 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:20:00.149539 10751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b20cf4b3d51a479390b494efbfb55108" candidate_uuid: "c067c1e31b7c4fd19544fa1d400045dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b204b786cbd45f0a263dc1d06c0577d" is_pre_election: true
I20260809 23:20:00.149700 10751 raft_consensus.cc:2454] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c067c1e31b7c4fd19544fa1d400045dc in term 0.
I20260809 23:20:00.149721 10997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.146359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:42325 (local address 127.1.235.129:43369)
0809 23:20:00.146612 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:00.146621 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:00.146692 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:00.146832 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:00.146833 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:00.146834 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:20:00.146919 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.146921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.147549 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.147551 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.148397 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.148400 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.149149 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.149150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.149219 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.149222 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:20:00.149576 (+ 354us) client_negotiation.cc:240] Negotiation successful
0809 23:20:00.149621 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":97,"thread_start_us":109,"threads_started":1}
I20260809 23:20:00.150038 10513 leader_election.cc:302] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b204b786cbd45f0a263dc1d06c0577d, c067c1e31b7c4fd19544fa1d400045dc; no voters:
I20260809 23:20:00.150041 10908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b20cf4b3d51a479390b494efbfb55108" candidate_uuid: "c067c1e31b7c4fd19544fa1d400045dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "286c7e3876d449cc82a589d1cd8ce568" is_pre_election: true
I20260809 23:20:00.150192 10995 raft_consensus.cc:2781] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:20:00.150219 10908 raft_consensus.cc:2454] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c067c1e31b7c4fd19544fa1d400045dc in term 0.
I20260809 23:20:00.150239 10995 raft_consensus.cc:482] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:20:00.150265 10995 raft_consensus.cc:3037] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Advancing to term 1
W20260809 23:20:00.151564 10802 tablet.cc:2369] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:20:00.151563 10995 raft_consensus.cc:504] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.151715 10995 leader_election.cc:288] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [CANDIDATE]: Term 1 election: Requested vote from peers 3b204b786cbd45f0a263dc1d06c0577d (127.1.235.130:46781), 286c7e3876d449cc82a589d1cd8ce568 (127.1.235.131:42325)
I20260809 23:20:00.151858 10908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b20cf4b3d51a479390b494efbfb55108" candidate_uuid: "c067c1e31b7c4fd19544fa1d400045dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "286c7e3876d449cc82a589d1cd8ce568"
I20260809 23:20:00.151957 10908 raft_consensus.cc:3037] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:00.151957 10751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b20cf4b3d51a479390b494efbfb55108" candidate_uuid: "c067c1e31b7c4fd19544fa1d400045dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b204b786cbd45f0a263dc1d06c0577d"
I20260809 23:20:00.152071 10751 raft_consensus.cc:3037] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:00.152804 10751 raft_consensus.cc:2454] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c067c1e31b7c4fd19544fa1d400045dc in term 1.
I20260809 23:20:00.152820 10908 raft_consensus.cc:2454] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c067c1e31b7c4fd19544fa1d400045dc in term 1.
I20260809 23:20:00.152997 10513 leader_election.cc:302] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b204b786cbd45f0a263dc1d06c0577d, c067c1e31b7c4fd19544fa1d400045dc; no voters:
I20260809 23:20:00.153101 10995 raft_consensus.cc:2781] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:20:00.153257 10995 raft_consensus.cc:686] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [term 1 LEADER]: Becoming Leader. State: Replica: c067c1e31b7c4fd19544fa1d400045dc, State: Running, Role: LEADER
I20260809 23:20:00.153370 10995 consensus_queue.cc:237] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.154220 10412 catalog_manager.cc:5495] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc reported cstate change: term changed from 0 to 1, leader changed from <none> to c067c1e31b7c4fd19544fa1d400045dc (127.1.235.129). New cstate: current_term: 1 leader_uuid: "c067c1e31b7c4fd19544fa1d400045dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } health_report { overall_health: UNKNOWN } } }
I20260809 23:20:00.167862 10987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.165365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41884 (local address 127.1.235.129:37415)
0809 23:20:00.165436 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.165438 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.165448 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:20:00.165504 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.165505 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.165520 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.165571 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:20:00.165736 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.166358 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.167107 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.167289 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.167345 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.167520 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:20:00.167618 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:20:00.167694 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.167731 (+ 37us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.167751 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 23:20:00.169608 10908 raft_consensus.cc:1261] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568 [term 1 FOLLOWER]: Refusing update from remote peer c067c1e31b7c4fd19544fa1d400045dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:20:00.169642 10751 raft_consensus.cc:1261] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d [term 1 FOLLOWER]: Refusing update from remote peer c067c1e31b7c4fd19544fa1d400045dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:20:00.170113 10998 consensus_queue.cc:1035] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:20:00.170260 10995 consensus_queue.cc:1035] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:20:00.173218 11003 mvcc.cc:205] Tried to move back new op lower bound from 7316756890292105216 to 7316756890228891648. Current Snapshot: MvccSnapshot[applied={T|T < 7316756890292105216}]
I20260809 23:20:00.173373 11001 mvcc.cc:205] Tried to move back new op lower bound from 7316756890292105216 to 7316756890228891648. Current Snapshot: MvccSnapshot[applied={T|T < 7316756890292105216 or (T in {7316756890292105216})}]
I20260809 23:20:00.174016 11004 mvcc.cc:205] Tried to move back new op lower bound from 7316756890292105216 to 7316756890228891648. Current Snapshot: MvccSnapshot[applied={T|T < 7316756890292105216}]
I20260809 23:20:00.174860 10413 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:20:00.174950 10413 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:20:00.175650 10413 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19: Sending DeleteTablet for 3 replicas of tablet b20cf4b3d51a479390b494efbfb55108
I20260809 23:20:00.175964 10728 tablet_service.cc:1514] Processing DeleteTablet for tablet b20cf4b3d51a479390b494efbfb55108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:20:00 UTC) from {username='oryx', principal='oryx/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:34390
I20260809 23:20:00.175958 10568 tablet_service.cc:1514] Processing DeleteTablet for tablet b20cf4b3d51a479390b494efbfb55108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:20:00 UTC) from {username='oryx', principal='oryx/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:41878
I20260809 23:20:00.176187 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet b20cf4b3d51a479390b494efbfb55108 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:20:00 UTC) from {username='oryx', principal='oryx/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:59070
I20260809 23:20:00.176222 10413 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46118:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:20:00.176388 10413 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:20:00.176453 11011 tablet_replica.cc:330] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d: stopping tablet replica
I20260809 23:20:00.176551 11011 raft_consensus.cc:2229] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:20:00.176685 11011 raft_consensus.cc:2258] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:20:00.177209 11011 ts_tablet_manager.cc:1905] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:20:00.177768 10728 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8a971dc1244c3b8a82bb3183a464e1 (DEFAULT_TABLE table=test-table [id=323a2caac4e04c3c8903cfbffc9a32a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:20:00.177770 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8a971dc1244c3b8a82bb3183a464e1 (DEFAULT_TABLE table=test-table [id=323a2caac4e04c3c8903cfbffc9a32a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:20:00.177913 10728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8a971dc1244c3b8a82bb3183a464e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:00.177923 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8a971dc1244c3b8a82bb3183a464e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:00.176962 11012 tablet_replica.cc:330] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc: stopping tablet replica
I20260809 23:20:00.177767 10568 tablet_service.cc:1467] Processing CreateTablet for tablet 0f8a971dc1244c3b8a82bb3183a464e1 (DEFAULT_TABLE table=test-table [id=323a2caac4e04c3c8903cfbffc9a32a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:20:00.179093 11012 raft_consensus.cc:2229] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:20:00.179132 10568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f8a971dc1244c3b8a82bb3183a464e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:00.179235 11012 raft_consensus.cc:2258] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:20:00.179386 11011 ts_tablet_manager.cc:1918] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:20:00.179433 10991 tablet_bootstrap.cc:492] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568: Bootstrap starting.
I20260809 23:20:00.179453 10989 tablet_bootstrap.cc:492] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d: Bootstrap starting.
I20260809 23:20:00.179445 11011 log.cc:1196] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/b20cf4b3d51a479390b494efbfb55108
I20260809 23:20:00.179823 11011 ts_tablet_manager.cc:1939] T b20cf4b3d51a479390b494efbfb55108 P 3b204b786cbd45f0a263dc1d06c0577d: Deleting consensus metadata
I20260809 23:20:00.179942 10989 tablet_bootstrap.cc:654] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:00.180202 10991 tablet_bootstrap.cc:654] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:00.180382 10396 catalog_manager.cc:4841] TS 3b204b786cbd45f0a263dc1d06c0577d (127.1.235.130:46781): tablet b20cf4b3d51a479390b494efbfb55108 (table test-table [id=20ae6bd1ef8d4c90b3c0b5f9267f266e]) successfully deleted
I20260809 23:20:00.180445 11012 ts_tablet_manager.cc:1905] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:20:00.180562 10988 tablet_bootstrap.cc:492] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc: Bootstrap starting.
I20260809 23:20:00.180971 10988 tablet_bootstrap.cc:654] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:00.181007 10989 tablet_bootstrap.cc:492] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d: No bootstrap required, opened a new log
I20260809 23:20:00.181048 10989 ts_tablet_manager.cc:1397] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:20:00.181216 10989 raft_consensus.cc:348] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.181286 10989 raft_consensus.cc:374] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:00.181306 10989 raft_consensus.cc:729] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b204b786cbd45f0a263dc1d06c0577d, State: Initialized, Role: FOLLOWER
I20260809 23:20:00.181353 10989 consensus_queue.cc:260] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.181456 10989 ts_tablet_manager.cc:1428] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:00.181747 10988 tablet_bootstrap.cc:492] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc: No bootstrap required, opened a new log
I20260809 23:20:00.181813 10988 ts_tablet_manager.cc:1397] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:00.181985 10988 raft_consensus.cc:348] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.182063 10988 raft_consensus.cc:374] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:00.182087 10988 raft_consensus.cc:729] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c067c1e31b7c4fd19544fa1d400045dc, State: Initialized, Role: FOLLOWER
I20260809 23:20:00.182132 10988 consensus_queue.cc:260] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.182220 10988 ts_tablet_manager.cc:1428] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:00.183509 11012 ts_tablet_manager.cc:1918] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:20:00.183602 11012 log.cc:1196] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/wal/wals/b20cf4b3d51a479390b494efbfb55108
I20260809 23:20:00.183867 11012 ts_tablet_manager.cc:1939] T b20cf4b3d51a479390b494efbfb55108 P c067c1e31b7c4fd19544fa1d400045dc: Deleting consensus metadata
I20260809 23:20:00.184247 10395 catalog_manager.cc:4841] TS c067c1e31b7c4fd19544fa1d400045dc (127.1.235.129:37415): tablet b20cf4b3d51a479390b494efbfb55108 (table test-table [id=20ae6bd1ef8d4c90b3c0b5f9267f266e]) successfully deleted
I20260809 23:20:00.186080 11013 tablet_replica.cc:330] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568: stopping tablet replica
I20260809 23:20:00.186200 11013 raft_consensus.cc:2229] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:20:00.186251 10991 tablet_bootstrap.cc:492] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568: No bootstrap required, opened a new log
I20260809 23:20:00.186308 10991 ts_tablet_manager.cc:1397] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260809 23:20:00.186314 11013 raft_consensus.cc:2258] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:20:00.186465 10991 raft_consensus.cc:348] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.186542 10991 raft_consensus.cc:374] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:00.186569 10991 raft_consensus.cc:729] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 286c7e3876d449cc82a589d1cd8ce568, State: Initialized, Role: FOLLOWER
I20260809 23:20:00.186612 10991 consensus_queue.cc:260] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.186702 10991 ts_tablet_manager.cc:1428] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:00.186735 11013 ts_tablet_manager.cc:1905] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:20:00.188077 11013 ts_tablet_manager.cc:1918] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:20:00.188169 11013 log.cc:1196] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/b20cf4b3d51a479390b494efbfb55108
I20260809 23:20:00.188424 11013 ts_tablet_manager.cc:1939] T b20cf4b3d51a479390b494efbfb55108 P 286c7e3876d449cc82a589d1cd8ce568: Deleting consensus metadata
I20260809 23:20:00.188799 10398 catalog_manager.cc:4841] TS 286c7e3876d449cc82a589d1cd8ce568 (127.1.235.131:42325): tablet b20cf4b3d51a479390b494efbfb55108 (table test-table [id=20ae6bd1ef8d4c90b3c0b5f9267f266e]) successfully deleted
W20260809 23:20:00.247136 10644 tablet.cc:2369] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 23:20:00.297833 10962 tablet.cc:2369] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:20:00.567754 10994 raft_consensus.cc:482] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:20:00.567864 10994 raft_consensus.cc:504] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.568339 10994 leader_election.cc:288] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c067c1e31b7c4fd19544fa1d400045dc (127.1.235.129:37415), 286c7e3876d449cc82a589d1cd8ce568 (127.1.235.131:42325)
I20260809 23:20:00.572010 10987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.568856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:42715 (local address 127.1.235.129:37415)
0809 23:20:00.568902 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.568904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.568913 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:20:00.568966 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.568967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.568981 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.569061 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:20:00.569259 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.570070 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.571197 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.571578 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.571706 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.571717 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.571892 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.571943 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 23:20:00.572024 11017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.568648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:37415 (local address 127.1.235.130:42715)
0809 23:20:00.568778 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:00.568790 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:00.568848 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:00.569075 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:00.569076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:00.569078 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:20:00.569175 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.569177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.570226 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.570227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.571080 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.571083 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.571707 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.571708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.571787 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.571790 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:20:00.571883 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 23:20:00.571927 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":37,"thread_start_us":62,"threads_started":1}
I20260809 23:20:00.572508 10594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8a971dc1244c3b8a82bb3183a464e1" candidate_uuid: "3b204b786cbd45f0a263dc1d06c0577d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c067c1e31b7c4fd19544fa1d400045dc" is_pre_election: true
I20260809 23:20:00.572664 10594 raft_consensus.cc:2454] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b204b786cbd45f0a263dc1d06c0577d in term 0.
I20260809 23:20:00.572860 10986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.568764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:44461 (local address 127.1.235.131:42325)
0809 23:20:00.568810 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.568812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.568851 (+ 39us) server_negotiation.cc:407] Connection header received
0809 23:20:00.569026 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.569027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.569053 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.569105 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:20:00.569348 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.570070 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.571730 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.572420 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.572471 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.572480 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.572716 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.572763 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 23:20:00.572898 10669 leader_election.cc:302] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b204b786cbd45f0a263dc1d06c0577d, c067c1e31b7c4fd19544fa1d400045dc; no voters:
I20260809 23:20:00.573051 10994 raft_consensus.cc:2781] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:20:00.573100 10994 raft_consensus.cc:482] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:20:00.573133 10994 raft_consensus.cc:3037] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:00.573237 11018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.568648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:42325 (local address 127.1.235.130:44461)
0809 23:20:00.568778 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:00.568790 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:00.568905 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:00.569148 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:00.569150 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:00.569152 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:20:00.569231 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.569233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.570159 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.570160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.571576 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.571580 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.572545 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.572546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.572630 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.572634 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:20:00.572998 (+ 364us) client_negotiation.cc:240] Negotiation successful
0809 23:20:00.573053 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":49,"thread_start_us":61,"threads_started":1}
I20260809 23:20:00.573554 10908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8a971dc1244c3b8a82bb3183a464e1" candidate_uuid: "3b204b786cbd45f0a263dc1d06c0577d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "286c7e3876d449cc82a589d1cd8ce568" is_pre_election: true
I20260809 23:20:00.573655 10908 raft_consensus.cc:2454] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b204b786cbd45f0a263dc1d06c0577d in term 0.
I20260809 23:20:00.574170 10994 raft_consensus.cc:504] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.574332 10994 leader_election.cc:288] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [CANDIDATE]: Term 1 election: Requested vote from peers c067c1e31b7c4fd19544fa1d400045dc (127.1.235.129:37415), 286c7e3876d449cc82a589d1cd8ce568 (127.1.235.131:42325)
I20260809 23:20:00.574484 10594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8a971dc1244c3b8a82bb3183a464e1" candidate_uuid: "3b204b786cbd45f0a263dc1d06c0577d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c067c1e31b7c4fd19544fa1d400045dc"
I20260809 23:20:00.574513 10908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f8a971dc1244c3b8a82bb3183a464e1" candidate_uuid: "3b204b786cbd45f0a263dc1d06c0577d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "286c7e3876d449cc82a589d1cd8ce568"
I20260809 23:20:00.574571 10594 raft_consensus.cc:3037] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:00.574584 10908 raft_consensus.cc:3037] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:00.575320 10908 raft_consensus.cc:2454] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b204b786cbd45f0a263dc1d06c0577d in term 1.
I20260809 23:20:00.575460 10594 raft_consensus.cc:2454] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b204b786cbd45f0a263dc1d06c0577d in term 1.
I20260809 23:20:00.575520 10672 leader_election.cc:302] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 286c7e3876d449cc82a589d1cd8ce568, 3b204b786cbd45f0a263dc1d06c0577d; no voters:
I20260809 23:20:00.575645 10994 raft_consensus.cc:2781] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:20:00.575778 10994 raft_consensus.cc:686] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [term 1 LEADER]: Becoming Leader. State: Replica: 3b204b786cbd45f0a263dc1d06c0577d, State: Running, Role: LEADER
I20260809 23:20:00.575852 10994 consensus_queue.cc:237] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.576644 10412 catalog_manager.cc:5495] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d reported cstate change: term changed from 0 to 1, leader changed from <none> to 3b204b786cbd45f0a263dc1d06c0577d (127.1.235.130). New cstate: current_term: 1 leader_uuid: "3b204b786cbd45f0a263dc1d06c0577d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } health_report { overall_health: UNKNOWN } } }
Aug 09 23:20:00 dist-test-slave-6nmv krb5kdc[10363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317599, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.190@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM
I20260809 23:20:00.649885 11027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.642508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:35329 (local address 127.0.0.1:46122)
0809 23:20:00.642724 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:00.642735 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:00.642824 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:00.643002 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:00.643003 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:00.643322 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:00.643383 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.643385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.644049 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.644050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.644586 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.644587 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.644974 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.644975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.645023 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.645557 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:00.645562 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:00.647090 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:20:00.648699 (+ 1609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:00.648707 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:00.648710 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:00.648925 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:00.649136 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:00.649137 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:00.649137 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:00.649197 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:00.649478 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:20:00.649488 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:20:00.649536 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 23:20:00.649647 (+ 111us) client_negotiation.cc:240] Negotiation successful
0809 23:20:00.649755 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":117,"threads_started":1}
I20260809 23:20:00.650192 11028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.642574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46122 (local address 127.1.235.190:35329)
0809 23:20:00.642714 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.642716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.642786 (+ 70us) server_negotiation.cc:407] Connection header received
0809 23:20:00.642894 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.642895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.642913 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.642985 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:00.643464 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.643966 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.644663 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.644845 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.644895 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.647172 (+ 2277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:00.647173 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:00.647174 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:20:00.647179 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:00.648598 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:00.648997 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:00.648997 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:00.648998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:00.649070 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:00.649257 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:00.649258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:00.649258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:00.649396 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:00.649468 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.649697 (+ 229us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.649858 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":109,"thread_start_us":77,"threads_started":1}
I20260809 23:20:00.652314 10412 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:46122:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 23:20:00.652542 10412 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:20:00.654119 10568 tablet_service.cc:1467] Processing CreateTablet for tablet 29ea5e6ebe65416ca4dc58394836eed3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6007b6e89515492480d7b9765ed6163d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 23:20:00.654131 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 29ea5e6ebe65416ca4dc58394836eed3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6007b6e89515492480d7b9765ed6163d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 23:20:00.654134 10728 tablet_service.cc:1467] Processing CreateTablet for tablet 29ea5e6ebe65416ca4dc58394836eed3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6007b6e89515492480d7b9765ed6163d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 23:20:00.654289 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29ea5e6ebe65416ca4dc58394836eed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:00.654289 10568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29ea5e6ebe65416ca4dc58394836eed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:00.654310 10728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29ea5e6ebe65416ca4dc58394836eed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:00.655860 10989 tablet_bootstrap.cc:492] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d: Bootstrap starting.
I20260809 23:20:00.655889 10991 tablet_bootstrap.cc:492] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568: Bootstrap starting.
I20260809 23:20:00.656234 10989 tablet_bootstrap.cc:654] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:00.656272 10991 tablet_bootstrap.cc:654] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:00.656621 10988 tablet_bootstrap.cc:492] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc: Bootstrap starting.
I20260809 23:20:00.656854 10989 tablet_bootstrap.cc:492] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d: No bootstrap required, opened a new log
I20260809 23:20:00.656895 10989 ts_tablet_manager.cc:1397] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:00.656960 10988 tablet_bootstrap.cc:654] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:00.657001 10989 raft_consensus.cc:348] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.657043 10989 raft_consensus.cc:374] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:00.657055 10989 raft_consensus.cc:729] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b204b786cbd45f0a263dc1d06c0577d, State: Initialized, Role: FOLLOWER
I20260809 23:20:00.657116 10989 consensus_queue.cc:260] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.657203 10989 ts_tablet_manager.cc:1428] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:00.657244 10994 tablet_replica.cc:439] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } } }
I20260809 23:20:00.657313 10994 tablet_replica.cc:442] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:20:00.657485 10991 tablet_bootstrap.cc:492] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568: No bootstrap required, opened a new log
I20260809 23:20:00.657552 10991 ts_tablet_manager.cc:1397] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:20:00.657737 10991 raft_consensus.cc:348] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.658051 10988 tablet_bootstrap.cc:492] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc: No bootstrap required, opened a new log
I20260809 23:20:00.658098 10988 ts_tablet_manager.cc:1397] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:00.658228 10988 raft_consensus.cc:348] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.658286 10988 raft_consensus.cc:374] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:00.658331 10988 raft_consensus.cc:729] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c067c1e31b7c4fd19544fa1d400045dc, State: Initialized, Role: FOLLOWER
I20260809 23:20:00.658386 10988 consensus_queue.cc:260] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.658506 10988 ts_tablet_manager.cc:1428] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:00.657792 10991 raft_consensus.cc:374] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:00.658600 10995 tablet_replica.cc:439] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } } }
I20260809 23:20:00.658691 10991 raft_consensus.cc:729] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 286c7e3876d449cc82a589d1cd8ce568, State: Initialized, Role: FOLLOWER
I20260809 23:20:00.658705 10995 tablet_replica.cc:442] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:20:00.658752 10991 consensus_queue.cc:260] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.658905 10991 ts_tablet_manager.cc:1428] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:00.658955 10996 tablet_replica.cc:439] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } } }
I20260809 23:20:00.659061 10996 tablet_replica.cc:442] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:20:00.681632 10995 raft_consensus.cc:482] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:20:00.681721 10995 raft_consensus.cc:504] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.681943 10995 leader_election.cc:288] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b204b786cbd45f0a263dc1d06c0577d (127.1.235.130:46781), 286c7e3876d449cc82a589d1cd8ce568 (127.1.235.131:42325)
I20260809 23:20:00.682123 10751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ea5e6ebe65416ca4dc58394836eed3" candidate_uuid: "c067c1e31b7c4fd19544fa1d400045dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b204b786cbd45f0a263dc1d06c0577d" is_pre_election: true
I20260809 23:20:00.682197 10908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ea5e6ebe65416ca4dc58394836eed3" candidate_uuid: "c067c1e31b7c4fd19544fa1d400045dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "286c7e3876d449cc82a589d1cd8ce568" is_pre_election: true
I20260809 23:20:00.682258 10751 raft_consensus.cc:2454] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c067c1e31b7c4fd19544fa1d400045dc in term 0.
I20260809 23:20:00.682277 10908 raft_consensus.cc:2454] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c067c1e31b7c4fd19544fa1d400045dc in term 0.
I20260809 23:20:00.682417 10513 leader_election.cc:302] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b204b786cbd45f0a263dc1d06c0577d, c067c1e31b7c4fd19544fa1d400045dc; no voters:
I20260809 23:20:00.682529 10995 raft_consensus.cc:2781] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:20:00.682583 10995 raft_consensus.cc:482] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:20:00.682636 10995 raft_consensus.cc:3037] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:00.683241 10995 raft_consensus.cc:504] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.683363 10995 leader_election.cc:288] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [CANDIDATE]: Term 1 election: Requested vote from peers 3b204b786cbd45f0a263dc1d06c0577d (127.1.235.130:46781), 286c7e3876d449cc82a589d1cd8ce568 (127.1.235.131:42325)
I20260809 23:20:00.683512 10908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ea5e6ebe65416ca4dc58394836eed3" candidate_uuid: "c067c1e31b7c4fd19544fa1d400045dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "286c7e3876d449cc82a589d1cd8ce568"
I20260809 23:20:00.683528 10751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29ea5e6ebe65416ca4dc58394836eed3" candidate_uuid: "c067c1e31b7c4fd19544fa1d400045dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b204b786cbd45f0a263dc1d06c0577d"
I20260809 23:20:00.683632 10908 raft_consensus.cc:3037] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:00.683632 10751 raft_consensus.cc:3037] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:00.684437 10908 raft_consensus.cc:2454] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c067c1e31b7c4fd19544fa1d400045dc in term 1.
I20260809 23:20:00.684437 10751 raft_consensus.cc:2454] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c067c1e31b7c4fd19544fa1d400045dc in term 1.
I20260809 23:20:00.684624 10513 leader_election.cc:302] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b204b786cbd45f0a263dc1d06c0577d, c067c1e31b7c4fd19544fa1d400045dc; no voters:
I20260809 23:20:00.684727 10995 raft_consensus.cc:2781] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:20:00.684880 10995 raft_consensus.cc:686] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [term 1 LEADER]: Becoming Leader. State: Replica: c067c1e31b7c4fd19544fa1d400045dc, State: Running, Role: LEADER
I20260809 23:20:00.684959 10995 consensus_queue.cc:237] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.685215 11032 tablet_replica.cc:439] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc: TxnStatusTablet state changed. Reason: New leader c067c1e31b7c4fd19544fa1d400045dc. Latest consensus state: current_term: 1 leader_uuid: "c067c1e31b7c4fd19544fa1d400045dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } } }
I20260809 23:20:00.685343 11032 tablet_replica.cc:442] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc: This TxnStatusTablet replica's current role is: LEADER
I20260809 23:20:00.685487 11035 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 23:20:00.685475 10412 catalog_manager.cc:5495] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc reported cstate change: term changed from 0 to 1, leader changed from <none> to c067c1e31b7c4fd19544fa1d400045dc (127.1.235.129). New cstate: current_term: 1 leader_uuid: "c067c1e31b7c4fd19544fa1d400045dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } health_report { overall_health: UNKNOWN } } }
I20260809 23:20:00.685602 11035 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 23:20:00.695973 10987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.693042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41894 (local address 127.1.235.129:37415)
0809 23:20:00.693096 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.693098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.693176 (+ 78us) server_negotiation.cc:407] Connection header received
0809 23:20:00.693274 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.693275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.693282 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.693326 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:20:00.693464 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.694040 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.695270 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.695448 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.695554 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.695755 (+ 201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:20:00.695782 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:20:00.695821 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.695910 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.695927 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 23:20:00.696039 11027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.692974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:37415 (local address 127.0.0.1:41894)
0809 23:20:00.693120 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:00.693134 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:00.693199 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:00.693335 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:00.693336 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:00.693337 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 23:20:00.693398 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.693401 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.694137 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.694138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.695186 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.695189 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.695574 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.695575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.695645 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.695663 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 23:20:00.695842 (+ 179us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 23:20:00.695850 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 23:20:00.695904 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 23:20:00.695957 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103}
I20260809 23:20:00.696919 10908 raft_consensus.cc:1261] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568 [term 1 FOLLOWER]: Refusing update from remote peer c067c1e31b7c4fd19544fa1d400045dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:20:00.696972 10751 raft_consensus.cc:1261] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d [term 1 FOLLOWER]: Refusing update from remote peer c067c1e31b7c4fd19544fa1d400045dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:20:00.697160 11032 consensus_queue.cc:1035] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:20:00.697237 10995 consensus_queue.cc:1035] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:20:00.697705 10994 tablet_replica.cc:439] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d: TxnStatusTablet state changed. Reason: New leader c067c1e31b7c4fd19544fa1d400045dc. Latest consensus state: current_term: 1 leader_uuid: "c067c1e31b7c4fd19544fa1d400045dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } } }
I20260809 23:20:00.697789 10994 tablet_replica.cc:442] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:20:00.697801 10996 tablet_replica.cc:439] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568: TxnStatusTablet state changed. Reason: New leader c067c1e31b7c4fd19544fa1d400045dc. Latest consensus state: current_term: 1 leader_uuid: "c067c1e31b7c4fd19544fa1d400045dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } } }
I20260809 23:20:00.697899 10996 tablet_replica.cc:442] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:20:00.698762 11032 tablet_replica.cc:439] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c067c1e31b7c4fd19544fa1d400045dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } } }
I20260809 23:20:00.698843 11032 tablet_replica.cc:442] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc: This TxnStatusTablet replica's current role is: LEADER
I20260809 23:20:00.699049 10994 tablet_replica.cc:439] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c067c1e31b7c4fd19544fa1d400045dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } } }
I20260809 23:20:00.699129 10994 tablet_replica.cc:442] T 29ea5e6ebe65416ca4dc58394836eed3 P 3b204b786cbd45f0a263dc1d06c0577d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:20:00.699323 10995 tablet_replica.cc:439] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c067c1e31b7c4fd19544fa1d400045dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } } }
I20260809 23:20:00.699402 10995 tablet_replica.cc:442] T 29ea5e6ebe65416ca4dc58394836eed3 P c067c1e31b7c4fd19544fa1d400045dc: This TxnStatusTablet replica's current role is: LEADER
I20260809 23:20:00.699764 10996 tablet_replica.cc:439] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c067c1e31b7c4fd19544fa1d400045dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } } }
I20260809 23:20:00.699841 10996 tablet_replica.cc:442] T 29ea5e6ebe65416ca4dc58394836eed3 P 286c7e3876d449cc82a589d1cd8ce568: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 23:20:00.703758 11050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.701097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34394 (local address 127.1.235.130:46781)
0809 23:20:00.701202 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.701204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.701214 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:20:00.701273 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.701273 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.701294 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.701375 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:20:00.701457 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.702300 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.702946 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.703278 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.703343 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.703457 (+ 114us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:20:00.703576 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:20:00.703644 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.703667 (+ 23us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.703686 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":61,"threads_started":1}
I20260809 23:20:00.708992 10987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.706330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:52401 (local address 127.1.235.129:37415)
0809 23:20:00.706384 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.706385 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.706502 (+ 117us) server_negotiation.cc:407] Connection header received
0809 23:20:00.706557 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.706558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.706566 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.706612 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:20:00.706727 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.707089 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.708174 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.708468 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.708506 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.708775 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:20:00.708800 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:20:00.708846 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.708939 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.708954 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 23:20:00.709077 11053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.706242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:37415 (local address 127.1.235.130:52401)
0809 23:20:00.706431 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:00.706442 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:00.706502 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:00.706617 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:00.706617 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:00.706619 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 23:20:00.706672 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.706673 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.707155 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.707156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.708073 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.708076 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.708598 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.708599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.708667 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.708681 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 23:20:00.708882 (+ 201us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 23:20:00.708884 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:20:00.708939 (+ 55us) client_negotiation.cc:240] Negotiation successful
0809 23:20:00.708980 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":89,"threads_started":1}
I20260809 23:20:00.711130 10908 raft_consensus.cc:1261] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568 [term 1 FOLLOWER]: Refusing update from remote peer 3b204b786cbd45f0a263dc1d06c0577d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:20:00.711205 10594 raft_consensus.cc:1261] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc [term 1 FOLLOWER]: Refusing update from remote peer 3b204b786cbd45f0a263dc1d06c0577d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:20:00.711374 11020 consensus_queue.cc:1035] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [LEADER]: Connected to new peer: Peer: permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:20:00.711483 10994 consensus_queue.cc:1035] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:20:00.719506 11050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.717158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:46905 (local address 127.1.235.130:46781)
0809 23:20:00.717191 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.717192 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.717332 (+ 140us) server_negotiation.cc:407] Connection header received
0809 23:20:00.717360 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.717361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.717371 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.717425 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:20:00.717522 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.718023 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.718724 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.718891 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.718955 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.719237 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:20:00.719269 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:20:00.719320 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.719419 (+ 99us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.719440 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:20:00.719549 11061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.717090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:46781 (local address 127.1.235.129:46905)
0809 23:20:00.717254 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:00.717264 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:00.717318 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:00.717428 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:00.717429 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:00.717431 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 23:20:00.717468 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.717470 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.718104 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.718105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.718646 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:00.718647 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.719062 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.719063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:00.719137 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.719153 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 23:20:00.719347 (+ 194us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 23:20:00.719350 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:20:00.719411 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 23:20:00.719453 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":72,"threads_started":1}
I20260809 23:20:00.732779 10412 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:20:00.732870 10412 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46118:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:20:00.733409 10412 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19: Sending DeleteTablet for 3 replicas of tablet 0f8a971dc1244c3b8a82bb3183a464e1
I20260809 23:20:00.733745 10568 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8a971dc1244c3b8a82bb3183a464e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:20:00 UTC) from {username='oryx', principal='oryx/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:41878
I20260809 23:20:00.733852 10728 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8a971dc1244c3b8a82bb3183a464e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:20:00 UTC) from {username='oryx', principal='oryx/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:34390
I20260809 23:20:00.734086 11067 tablet_replica.cc:330] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d: stopping tablet replica
I20260809 23:20:00.734155 11067 raft_consensus.cc:2229] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:20:00.734229 11067 raft_consensus.cc:2258] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:20:00.734347 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f8a971dc1244c3b8a82bb3183a464e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:20:00 UTC) from {username='oryx', principal='oryx/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:59070
I20260809 23:20:00.734573 11067 ts_tablet_manager.cc:1905] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:20:00.734720 11069 tablet_replica.cc:330] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568: stopping tablet replica
I20260809 23:20:00.734830 11069 raft_consensus.cc:2229] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:20:00.734920 11069 raft_consensus.cc:2258] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:20:00.735216 11069 ts_tablet_manager.cc:1905] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:20:00.736959 11069 ts_tablet_manager.cc:1918] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 23:20:00.737075 11069 log.cc:1196] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/0f8a971dc1244c3b8a82bb3183a464e1
I20260809 23:20:00.737416 11069 ts_tablet_manager.cc:1939] T 0f8a971dc1244c3b8a82bb3183a464e1 P 286c7e3876d449cc82a589d1cd8ce568: Deleting consensus metadata
I20260809 23:20:00.737797 10398 catalog_manager.cc:4841] TS 286c7e3876d449cc82a589d1cd8ce568 (127.1.235.131:42325): tablet 0f8a971dc1244c3b8a82bb3183a464e1 (table test-table [id=323a2caac4e04c3c8903cfbffc9a32a2]) successfully deleted
I20260809 23:20:00.737941 11068 tablet_replica.cc:330] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc: stopping tablet replica
I20260809 23:20:00.739769 11067 ts_tablet_manager.cc:1918] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 23:20:00.739835 11067 log.cc:1196] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/0f8a971dc1244c3b8a82bb3183a464e1
I20260809 23:20:00.740068 11067 ts_tablet_manager.cc:1939] T 0f8a971dc1244c3b8a82bb3183a464e1 P 3b204b786cbd45f0a263dc1d06c0577d: Deleting consensus metadata
I20260809 23:20:00.740399 10396 catalog_manager.cc:4841] TS 3b204b786cbd45f0a263dc1d06c0577d (127.1.235.130:46781): tablet 0f8a971dc1244c3b8a82bb3183a464e1 (table test-table [id=323a2caac4e04c3c8903cfbffc9a32a2]) successfully deleted
I20260809 23:20:00.741900 11068 raft_consensus.cc:2229] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:20:00.742017 11068 raft_consensus.cc:2258] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:20:00.742316 11068 ts_tablet_manager.cc:1905] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:20:00.743968 11068 ts_tablet_manager.cc:1918] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 23:20:00.744035 11068 log.cc:1196] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/wal/wals/0f8a971dc1244c3b8a82bb3183a464e1
I20260809 23:20:00.744290 11068 ts_tablet_manager.cc:1939] T 0f8a971dc1244c3b8a82bb3183a464e1 P c067c1e31b7c4fd19544fa1d400045dc: Deleting consensus metadata
I20260809 23:20:00.744609 10395 catalog_manager.cc:4841] TS c067c1e31b7c4fd19544fa1d400045dc (127.1.235.129:37415): tablet 0f8a971dc1244c3b8a82bb3183a464e1 (table test-table [id=323a2caac4e04c3c8903cfbffc9a32a2]) successfully deleted
Aug 09 23:20:00 dist-test-slave-6nmv krb5kdc[10363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 23:20:00 dist-test-slave-6nmv krb5kdc[10363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:00 dist-test-slave-6nmv krb5kdc[10363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 23:20:00.774509 11028 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:00.767141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46128 (local address 127.1.235.190:35329)
0809 23:20:00.767209 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.767211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.767331 (+ 120us) server_negotiation.cc:407] Connection header received
0809 23:20:00.767406 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.767406 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.767419 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.767490 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:00.768288 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.769106 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.770300 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.770611 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.770680 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.774436 (+ 3756us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46128: BlockingRecv error: recv got EOF from 127.0.0.1:46128 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 09 23:20:00 dist-test-slave-6nmv krb5kdc[10363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317600, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM
I20260809 23:20:00.784605 11028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.775272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46130 (local address 127.1.235.190:35329)
0809 23:20:00.775310 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.775312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.775580 (+ 268us) server_negotiation.cc:407] Connection header received
0809 23:20:00.775617 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.775617 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.775629 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.775696 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:00.776281 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.777062 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.778159 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.778495 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.778595 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.781443 (+ 2848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:00.781444 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:00.781444 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:20:00.781452 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:00.783233 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:00.783684 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:00.783685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:00.783685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:00.783749 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:00.784018 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:00.784019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:00.784019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:00.784159 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:00.784260 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.784424 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.784506 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:20:00.786623 10412 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46130:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:20:00.786805 10412 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:20:00.788345 10568 tablet_service.cc:1467] Processing CreateTablet for tablet 791e8ef7b4bf40edb0a26f95a61cfaf8 (DEFAULT_TABLE table=test-table [id=2ea372d627124c7097dd7b31ce6a6973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:20:00.788507 10568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 791e8ef7b4bf40edb0a26f95a61cfaf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:00.789994 10881 tablet_service.cc:1467] Processing CreateTablet for tablet 791e8ef7b4bf40edb0a26f95a61cfaf8 (DEFAULT_TABLE table=test-table [id=2ea372d627124c7097dd7b31ce6a6973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:20:00.790024 10988 tablet_bootstrap.cc:492] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc: Bootstrap starting.
I20260809 23:20:00.790138 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 791e8ef7b4bf40edb0a26f95a61cfaf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:00.790340 10988 tablet_bootstrap.cc:654] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:00.791091 10988 tablet_bootstrap.cc:492] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc: No bootstrap required, opened a new log
I20260809 23:20:00.791137 10988 ts_tablet_manager.cc:1397] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:00.791240 10988 raft_consensus.cc:348] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.791308 10988 raft_consensus.cc:374] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:00.791330 10988 raft_consensus.cc:729] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c067c1e31b7c4fd19544fa1d400045dc, State: Initialized, Role: FOLLOWER
I20260809 23:20:00.791378 10988 consensus_queue.cc:260] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.791419 10728 tablet_service.cc:1467] Processing CreateTablet for tablet 791e8ef7b4bf40edb0a26f95a61cfaf8 (DEFAULT_TABLE table=test-table [id=2ea372d627124c7097dd7b31ce6a6973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:20:00.791503 10988 ts_tablet_manager.cc:1428] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 23:20:00.791544 10728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 791e8ef7b4bf40edb0a26f95a61cfaf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:00.792862 10991 tablet_bootstrap.cc:492] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568: Bootstrap starting.
I20260809 23:20:00.792872 10989 tablet_bootstrap.cc:492] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d: Bootstrap starting.
I20260809 23:20:00.793290 10991 tablet_bootstrap.cc:654] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:00.793392 10989 tablet_bootstrap.cc:654] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:00.794572 10989 tablet_bootstrap.cc:492] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d: No bootstrap required, opened a new log
I20260809 23:20:00.794629 10989 ts_tablet_manager.cc:1397] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 23:20:00.794776 10989 raft_consensus.cc:348] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.794816 10991 tablet_bootstrap.cc:492] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568: No bootstrap required, opened a new log
I20260809 23:20:00.794845 10989 raft_consensus.cc:374] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:00.794860 10991 ts_tablet_manager.cc:1397] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:20:00.794869 10989 raft_consensus.cc:729] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b204b786cbd45f0a263dc1d06c0577d, State: Initialized, Role: FOLLOWER
I20260809 23:20:00.794916 10989 consensus_queue.cc:260] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.795007 10989 ts_tablet_manager.cc:1428] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:00.795006 10991 raft_consensus.cc:348] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.795083 10991 raft_consensus.cc:374] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:00.795115 10991 raft_consensus.cc:729] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 286c7e3876d449cc82a589d1cd8ce568, State: Initialized, Role: FOLLOWER
I20260809 23:20:00.795166 10991 consensus_queue.cc:260] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.795257 10991 ts_tablet_manager.cc:1428] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260809 23:20:00.805334 11032 raft_consensus.cc:482] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:20:00.805411 11032 raft_consensus.cc:504] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.805568 11032 leader_election.cc:288] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b204b786cbd45f0a263dc1d06c0577d (127.1.235.130:46781), 286c7e3876d449cc82a589d1cd8ce568 (127.1.235.131:42325)
I20260809 23:20:00.805756 10751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791e8ef7b4bf40edb0a26f95a61cfaf8" candidate_uuid: "c067c1e31b7c4fd19544fa1d400045dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b204b786cbd45f0a263dc1d06c0577d" is_pre_election: true
I20260809 23:20:00.805771 10908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791e8ef7b4bf40edb0a26f95a61cfaf8" candidate_uuid: "c067c1e31b7c4fd19544fa1d400045dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "286c7e3876d449cc82a589d1cd8ce568" is_pre_election: true
I20260809 23:20:00.805874 10751 raft_consensus.cc:2454] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c067c1e31b7c4fd19544fa1d400045dc in term 0.
I20260809 23:20:00.805914 10908 raft_consensus.cc:2454] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c067c1e31b7c4fd19544fa1d400045dc in term 0.
I20260809 23:20:00.806020 10513 leader_election.cc:302] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b204b786cbd45f0a263dc1d06c0577d, c067c1e31b7c4fd19544fa1d400045dc; no voters:
I20260809 23:20:00.806172 11032 raft_consensus.cc:2781] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:20:00.806205 11032 raft_consensus.cc:482] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:20:00.806224 11032 raft_consensus.cc:3037] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:00.807026 11032 raft_consensus.cc:504] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.807161 11032 leader_election.cc:288] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [CANDIDATE]: Term 1 election: Requested vote from peers 3b204b786cbd45f0a263dc1d06c0577d (127.1.235.130:46781), 286c7e3876d449cc82a589d1cd8ce568 (127.1.235.131:42325)
I20260809 23:20:00.807422 10908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791e8ef7b4bf40edb0a26f95a61cfaf8" candidate_uuid: "c067c1e31b7c4fd19544fa1d400045dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "286c7e3876d449cc82a589d1cd8ce568"
I20260809 23:20:00.807495 10908 raft_consensus.cc:3037] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:00.808224 10908 raft_consensus.cc:2454] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c067c1e31b7c4fd19544fa1d400045dc in term 1.
I20260809 23:20:00.808332 10751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "791e8ef7b4bf40edb0a26f95a61cfaf8" candidate_uuid: "c067c1e31b7c4fd19544fa1d400045dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b204b786cbd45f0a263dc1d06c0577d"
I20260809 23:20:00.808403 10751 raft_consensus.cc:3037] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:00.809059 10751 raft_consensus.cc:2454] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c067c1e31b7c4fd19544fa1d400045dc in term 1.
I20260809 23:20:00.809234 10515 leader_election.cc:302] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 286c7e3876d449cc82a589d1cd8ce568, c067c1e31b7c4fd19544fa1d400045dc; no voters:
I20260809 23:20:00.809502 11032 raft_consensus.cc:2781] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:20:00.809569 11032 raft_consensus.cc:686] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [term 1 LEADER]: Becoming Leader. State: Replica: c067c1e31b7c4fd19544fa1d400045dc, State: Running, Role: LEADER
I20260809 23:20:00.809613 11032 consensus_queue.cc:237] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.810184 10413 catalog_manager.cc:5495] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc reported cstate change: term changed from 0 to 1, leader changed from <none> to c067c1e31b7c4fd19544fa1d400045dc (127.1.235.129). New cstate: current_term: 1 leader_uuid: "c067c1e31b7c4fd19544fa1d400045dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } health_report { overall_health: UNKNOWN } } }
I20260809 23:20:00.816484 10987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:00.813265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41902 (local address 127.1.235.129:37415)
0809 23:20:00.813304 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:00.813306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:00.813312 (+ 6us) server_negotiation.cc:407] Connection header received
0809 23:20:00.813334 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:00.813335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:00.813345 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:00.813403 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:20:00.813610 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.814452 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.815600 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:00.815910 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:00.815972 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:00.816160 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:20:00.816193 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:20:00.816236 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:00.816381 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 23:20:00.816415 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 23:20:00.817402 10751 raft_consensus.cc:1261] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d [term 1 FOLLOWER]: Refusing update from remote peer c067c1e31b7c4fd19544fa1d400045dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:20:00.817535 10908 raft_consensus.cc:1261] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568 [term 1 FOLLOWER]: Refusing update from remote peer c067c1e31b7c4fd19544fa1d400045dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:20:00.817718 11032 consensus_queue.cc:1035] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:20:00.817799 10995 consensus_queue.cc:1035] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:20:00.820698 10412 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:20:00.820775 10412 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:20:00.821314 10412 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19: Sending DeleteTablet for 3 replicas of tablet 791e8ef7b4bf40edb0a26f95a61cfaf8
I20260809 23:20:00.821555 10568 tablet_service.cc:1514] Processing DeleteTablet for tablet 791e8ef7b4bf40edb0a26f95a61cfaf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:20:00 UTC) from {username='oryx', principal='oryx/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:41878
I20260809 23:20:00.821656 11068 tablet_replica.cc:330] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc: stopping tablet replica
I20260809 23:20:00.821663 10728 tablet_service.cc:1514] Processing DeleteTablet for tablet 791e8ef7b4bf40edb0a26f95a61cfaf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:20:00 UTC) from {username='oryx', principal='oryx/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:34390
I20260809 23:20:00.821695 11068 raft_consensus.cc:2229] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:20:00.821743 11067 tablet_replica.cc:330] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d: stopping tablet replica
I20260809 23:20:00.821756 11068 raft_consensus.cc:2258] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:20:00.821782 11067 raft_consensus.cc:2229] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:20:00.821846 11067 raft_consensus.cc:2258] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:20:00.821964 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet 791e8ef7b4bf40edb0a26f95a61cfaf8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:20:00 UTC) from {username='oryx', principal='oryx/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:59070
I20260809 23:20:00.822049 11069 tablet_replica.cc:330] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568: stopping tablet replica
I20260809 23:20:00.822108 11069 raft_consensus.cc:2229] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:20:00.822142 11069 raft_consensus.cc:2258] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:20:00.822199 11068 ts_tablet_manager.cc:1905] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:20:00.822727 10412 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46130:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:20:00.822871 10412 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:20:00.823697 11068 ts_tablet_manager.cc:1918] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:20:00.823758 11068 log.cc:1196] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/wal/wals/791e8ef7b4bf40edb0a26f95a61cfaf8
I20260809 23:20:00.823995 11068 ts_tablet_manager.cc:1939] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P c067c1e31b7c4fd19544fa1d400045dc: Deleting consensus metadata
I20260809 23:20:00.824213 10881 tablet_service.cc:1467] Processing CreateTablet for tablet eed57f375a614f5d9c639c2df6d9c32f (DEFAULT_TABLE table=test-table [id=8b52dd446f6a41e182856767ec0ef567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:20:00.824321 10881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed57f375a614f5d9c639c2df6d9c32f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:00.824709 11069 ts_tablet_manager.cc:1905] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:20:00.825686 10991 tablet_bootstrap.cc:492] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568: Bootstrap starting.
I20260809 23:20:00.826102 10991 tablet_bootstrap.cc:654] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:00.826167 11069 ts_tablet_manager.cc:1918] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:20:00.826220 11069 log.cc:1196] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/791e8ef7b4bf40edb0a26f95a61cfaf8
I20260809 23:20:00.826429 11069 ts_tablet_manager.cc:1939] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 286c7e3876d449cc82a589d1cd8ce568: Deleting consensus metadata
I20260809 23:20:00.826704 10728 tablet_service.cc:1467] Processing CreateTablet for tablet eed57f375a614f5d9c639c2df6d9c32f (DEFAULT_TABLE table=test-table [id=8b52dd446f6a41e182856767ec0ef567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:20:00.826814 10728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed57f375a614f5d9c639c2df6d9c32f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:00.828024 10989 tablet_bootstrap.cc:492] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d: Bootstrap starting.
I20260809 23:20:00.828438 10989 tablet_bootstrap.cc:654] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:00.828903 10398 catalog_manager.cc:4841] TS 286c7e3876d449cc82a589d1cd8ce568 (127.1.235.131:42325): tablet 791e8ef7b4bf40edb0a26f95a61cfaf8 (table test-table [id=2ea372d627124c7097dd7b31ce6a6973]) successfully deleted
I20260809 23:20:00.829109 10395 catalog_manager.cc:4841] TS c067c1e31b7c4fd19544fa1d400045dc (127.1.235.129:37415): tablet 791e8ef7b4bf40edb0a26f95a61cfaf8 (table test-table [id=2ea372d627124c7097dd7b31ce6a6973]) successfully deleted
I20260809 23:20:00.829167 10989 tablet_bootstrap.cc:492] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d: No bootstrap required, opened a new log
I20260809 23:20:00.829209 10989 ts_tablet_manager.cc:1397] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260809 23:20:00.829273 10568 tablet_service.cc:1467] Processing CreateTablet for tablet eed57f375a614f5d9c639c2df6d9c32f (DEFAULT_TABLE table=test-table [id=8b52dd446f6a41e182856767ec0ef567]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:20:00.829356 10989 raft_consensus.cc:348] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.829396 10568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eed57f375a614f5d9c639c2df6d9c32f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:00.829417 10989 raft_consensus.cc:374] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:00.829464 10989 raft_consensus.cc:729] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b204b786cbd45f0a263dc1d06c0577d, State: Initialized, Role: FOLLOWER
I20260809 23:20:00.829502 10989 consensus_queue.cc:260] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.829587 10989 ts_tablet_manager.cc:1428] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 23:20:00.830826 10988 tablet_bootstrap.cc:492] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc: Bootstrap starting.
I20260809 23:20:00.831234 10988 tablet_bootstrap.cc:654] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:00.831972 10988 tablet_bootstrap.cc:492] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc: No bootstrap required, opened a new log
I20260809 23:20:00.832031 10988 ts_tablet_manager.cc:1397] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:00.832154 10988 raft_consensus.cc:348] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.832226 10988 raft_consensus.cc:374] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:00.832247 10988 raft_consensus.cc:729] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c067c1e31b7c4fd19544fa1d400045dc, State: Initialized, Role: FOLLOWER
I20260809 23:20:00.832289 10988 consensus_queue.cc:260] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.832391 10988 ts_tablet_manager.cc:1428] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:00.832598 10991 tablet_bootstrap.cc:492] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568: No bootstrap required, opened a new log
I20260809 23:20:00.832651 10991 ts_tablet_manager.cc:1397] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260809 23:20:00.832793 10991 raft_consensus.cc:348] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.832867 10991 raft_consensus.cc:374] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:00.832887 10991 raft_consensus.cc:729] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 286c7e3876d449cc82a589d1cd8ce568, State: Initialized, Role: FOLLOWER
I20260809 23:20:00.832926 10991 consensus_queue.cc:260] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:00.833002 10991 ts_tablet_manager.cc:1428] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:00.834110 11067 ts_tablet_manager.cc:1905] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:20:00.835631 11067 ts_tablet_manager.cc:1918] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:20:00.835680 11067 log.cc:1196] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/791e8ef7b4bf40edb0a26f95a61cfaf8
I20260809 23:20:00.835877 11067 ts_tablet_manager.cc:1939] T 791e8ef7b4bf40edb0a26f95a61cfaf8 P 3b204b786cbd45f0a263dc1d06c0577d: Deleting consensus metadata
I20260809 23:20:00.836417 10396 catalog_manager.cc:4841] TS 3b204b786cbd45f0a263dc1d06c0577d (127.1.235.130:46781): tablet 791e8ef7b4bf40edb0a26f95a61cfaf8 (table test-table [id=2ea372d627124c7097dd7b31ce6a6973]) successfully deleted
I20260809 23:20:01.125217 10996 raft_consensus.cc:482] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:20:01.125324 10996 raft_consensus.cc:504] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:01.125628 10996 leader_election.cc:288] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c067c1e31b7c4fd19544fa1d400045dc (127.1.235.129:37415), 3b204b786cbd45f0a263dc1d06c0577d (127.1.235.130:46781)
I20260809 23:20:01.128621 11050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:01.125905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:40423 (local address 127.1.235.130:46781)
0809 23:20:01.125952 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:01.125955 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:01.126072 (+ 117us) server_negotiation.cc:407] Connection header received
0809 23:20:01.126146 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:01.126147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:01.126157 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:01.126238 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:20:01.126371 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.126872 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.127943 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.128282 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.128369 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:01.128377 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:01.128517 (+ 140us) server_negotiation.cc:299] Negotiation successful
0809 23:20:01.128552 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 23:20:01.128640 10987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:01.125919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:42431 (local address 127.1.235.129:37415)
0809 23:20:01.125977 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:01.125980 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:01.126049 (+ 69us) server_negotiation.cc:407] Connection header received
0809 23:20:01.126197 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:01.126198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:01.126209 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:01.126256 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:20:01.126422 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.126926 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.127951 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.128299 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.128376 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:01.128387 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:01.128537 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 23:20:01.128571 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 23:20:01.128661 11095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:01.125828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:37415 (local address 127.1.235.131:42431)
0809 23:20:01.125972 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:01.125983 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:01.126067 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:01.126259 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:01.126260 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:01.126262 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:20:01.126333 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:01.126335 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.127036 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.127037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:01.127851 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:01.127853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.128382 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.128383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:01.128465 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:01.128468 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:20:01.128530 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 23:20:01.128569 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":81,"threads_started":1}
I20260809 23:20:01.128670 11094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:01.125831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:46781 (local address 127.1.235.131:40423)
0809 23:20:01.125993 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:01.126006 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:01.126088 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:01.126241 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:01.126242 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:01.126243 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:20:01.126299 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:01.126301 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.126966 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.126967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:01.127841 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:01.127843 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.128373 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.128374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:01.128444 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:01.128447 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:20:01.128510 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 23:20:01.128547 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":79,"threads_started":1}
I20260809 23:20:01.129014 10751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed57f375a614f5d9c639c2df6d9c32f" candidate_uuid: "286c7e3876d449cc82a589d1cd8ce568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b204b786cbd45f0a263dc1d06c0577d" is_pre_election: true
I20260809 23:20:01.129019 10594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed57f375a614f5d9c639c2df6d9c32f" candidate_uuid: "286c7e3876d449cc82a589d1cd8ce568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c067c1e31b7c4fd19544fa1d400045dc" is_pre_election: true
I20260809 23:20:01.129108 10594 raft_consensus.cc:2454] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 286c7e3876d449cc82a589d1cd8ce568 in term 0.
I20260809 23:20:01.129107 10751 raft_consensus.cc:2454] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 286c7e3876d449cc82a589d1cd8ce568 in term 0.
I20260809 23:20:01.129279 10831 leader_election.cc:302] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 286c7e3876d449cc82a589d1cd8ce568, 3b204b786cbd45f0a263dc1d06c0577d, c067c1e31b7c4fd19544fa1d400045dc; no voters:
I20260809 23:20:01.129412 10996 raft_consensus.cc:2781] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:20:01.129455 10996 raft_consensus.cc:482] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:20:01.129469 10996 raft_consensus.cc:3037] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:01.130225 10996 raft_consensus.cc:504] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:01.130360 10996 leader_election.cc:288] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [CANDIDATE]: Term 1 election: Requested vote from peers c067c1e31b7c4fd19544fa1d400045dc (127.1.235.129:37415), 3b204b786cbd45f0a263dc1d06c0577d (127.1.235.130:46781)
I20260809 23:20:01.130543 10594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed57f375a614f5d9c639c2df6d9c32f" candidate_uuid: "286c7e3876d449cc82a589d1cd8ce568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c067c1e31b7c4fd19544fa1d400045dc"
I20260809 23:20:01.130630 10594 raft_consensus.cc:3037] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:01.130613 10751 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eed57f375a614f5d9c639c2df6d9c32f" candidate_uuid: "286c7e3876d449cc82a589d1cd8ce568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b204b786cbd45f0a263dc1d06c0577d"
I20260809 23:20:01.130722 10751 raft_consensus.cc:3037] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:01.131234 10594 raft_consensus.cc:2454] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 286c7e3876d449cc82a589d1cd8ce568 in term 1.
I20260809 23:20:01.131352 10751 raft_consensus.cc:2454] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 286c7e3876d449cc82a589d1cd8ce568 in term 1.
I20260809 23:20:01.131420 10830 leader_election.cc:302] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 286c7e3876d449cc82a589d1cd8ce568, c067c1e31b7c4fd19544fa1d400045dc; no voters:
I20260809 23:20:01.131500 10996 raft_consensus.cc:2781] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:20:01.131688 10996 raft_consensus.cc:686] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [term 1 LEADER]: Becoming Leader. State: Replica: 286c7e3876d449cc82a589d1cd8ce568, State: Running, Role: LEADER
I20260809 23:20:01.131781 10996 consensus_queue.cc:237] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } }
I20260809 23:20:01.132452 10412 catalog_manager.cc:5495] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 reported cstate change: term changed from 0 to 1, leader changed from <none> to 286c7e3876d449cc82a589d1cd8ce568 (127.1.235.131). New cstate: current_term: 1 leader_uuid: "286c7e3876d449cc82a589d1cd8ce568" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "286c7e3876d449cc82a589d1cd8ce568" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 42325 } health_report { overall_health: HEALTHY } } }
I20260809 23:20:01.189260 11098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:01.187139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59086 (local address 127.1.235.131:42325)
0809 23:20:01.187280 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:01.187282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:01.187290 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:20:01.187329 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:01.187329 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:01.187347 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:01.187413 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:20:01.187511 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.187962 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.188567 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.188765 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.188822 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:01.188924 (+ 102us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:20:01.189019 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:20:01.189065 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:01.189103 (+ 38us) server_negotiation.cc:299] Negotiation successful
0809 23:20:01.189119 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":71,"threads_started":1}
I20260809 23:20:01.193744 10987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:01.191726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:42077 (local address 127.1.235.129:37415)
0809 23:20:01.191775 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:01.191776 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:01.191815 (+ 39us) server_negotiation.cc:407] Connection header received
0809 23:20:01.191879 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:01.191880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:01.191891 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:01.191943 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:20:01.192087 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.192501 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.193207 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.193375 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.193422 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:01.193570 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:20:01.193598 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:20:01.193633 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:01.193682 (+ 49us) server_negotiation.cc:299] Negotiation successful
0809 23:20:01.193697 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 23:20:01.193867 11102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:01.191586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:37415 (local address 127.1.235.131:42077)
0809 23:20:01.191757 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:01.191768 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:01.191830 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:01.191958 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:01.191959 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:01.191960 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 23:20:01.192021 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:01.192022 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.192585 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.192586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:01.193132 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:01.193133 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.193439 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.193440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:01.193491 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:01.193503 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 23:20:01.193646 (+ 143us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 23:20:01.193647 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 23:20:01.193675 (+ 28us) client_negotiation.cc:240] Negotiation successful
0809 23:20:01.193708 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":97,"threads_started":1}
I20260809 23:20:01.196036 10751 raft_consensus.cc:1261] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d [term 1 FOLLOWER]: Refusing update from remote peer 286c7e3876d449cc82a589d1cd8ce568: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:20:01.196072 10594 raft_consensus.cc:1261] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc [term 1 FOLLOWER]: Refusing update from remote peer 286c7e3876d449cc82a589d1cd8ce568: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:20:01.196298 11096 consensus_queue.cc:1035] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c067c1e31b7c4fd19544fa1d400045dc" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:20:01.196471 10996 consensus_queue.cc:1035] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b204b786cbd45f0a263dc1d06c0577d" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 46781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:20:01.203171 11098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:01.201253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:56063 (local address 127.1.235.131:42325)
0809 23:20:01.201285 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:01.201287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:01.201296 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:20:01.201318 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:01.201319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:01.201326 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:01.201401 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:20:01.201499 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.202009 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.202596 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.202749 (+ 153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.202791 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:01.202937 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:20:01.202964 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:20:01.203010 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:01.203061 (+ 51us) server_negotiation.cc:299] Negotiation successful
0809 23:20:01.203082 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 23:20:01.203176 11061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:01.201199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:42325 (local address 127.1.235.129:56063)
0809 23:20:01.201231 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:01.201240 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:01.201275 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:01.201403 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:01.201404 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:01.201405 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 23:20:01.201443 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:01.201445 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.202065 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.202066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:01.202533 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:01.202534 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:01.202804 (+ 270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:01.202805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:01.202865 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:01.202872 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 23:20:01.203019 (+ 147us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 23:20:01.203020 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 23:20:01.203058 (+ 38us) client_negotiation.cc:240] Negotiation successful
0809 23:20:01.203110 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260809 23:20:01.210048 10413 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:20:01.210146 10413 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:20:01.210803 10413 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b0d231077a7c41efb741fccae1136d19: Sending DeleteTablet for 3 replicas of tablet eed57f375a614f5d9c639c2df6d9c32f
I20260809 23:20:01.211081 10728 tablet_service.cc:1514] Processing DeleteTablet for tablet eed57f375a614f5d9c639c2df6d9c32f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:20:01 UTC) from {username='oryx', principal='oryx/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:34390
I20260809 23:20:01.211117 10568 tablet_service.cc:1514] Processing DeleteTablet for tablet eed57f375a614f5d9c639c2df6d9c32f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:20:01 UTC) from {username='oryx', principal='oryx/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:41878
I20260809 23:20:01.211153 10881 tablet_service.cc:1514] Processing DeleteTablet for tablet eed57f375a614f5d9c639c2df6d9c32f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:20:01 UTC) from {username='oryx', principal='oryx/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:59070
I20260809 23:20:01.211186 11068 tablet_replica.cc:330] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc: stopping tablet replica
I20260809 23:20:01.211218 11067 tablet_replica.cc:330] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d: stopping tablet replica
I20260809 23:20:01.211226 11069 tablet_replica.cc:330] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568: stopping tablet replica
I20260809 23:20:01.211241 11068 raft_consensus.cc:2229] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:20:01.211268 11069 raft_consensus.cc:2229] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:20:01.211264 11067 raft_consensus.cc:2229] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:20:01.211273 11068 raft_consensus.cc:2258] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:20:01.211295 11067 raft_consensus.cc:2258] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:20:01.211336 11069 raft_consensus.cc:2258] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:20:01.211592 11068 ts_tablet_manager.cc:1905] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:20:01.211592 11067 ts_tablet_manager.cc:1905] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:20:01.211624 11069 ts_tablet_manager.cc:1905] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:20:01.213290 11067 ts_tablet_manager.cc:1918] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 23:20:01.213348 11067 log.cc:1196] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/eed57f375a614f5d9c639c2df6d9c32f
I20260809 23:20:01.213342 11069 ts_tablet_manager.cc:1918] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 23:20:01.213394 11069 log.cc:1196] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/eed57f375a614f5d9c639c2df6d9c32f
I20260809 23:20:01.213435 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 10495
I20260809 23:20:01.213575 11067 ts_tablet_manager.cc:1939] T eed57f375a614f5d9c639c2df6d9c32f P 3b204b786cbd45f0a263dc1d06c0577d: Deleting consensus metadata
I20260809 23:20:01.213617 11069 ts_tablet_manager.cc:1939] T eed57f375a614f5d9c639c2df6d9c32f P 286c7e3876d449cc82a589d1cd8ce568: Deleting consensus metadata
I20260809 23:20:01.213726 11068 ts_tablet_manager.cc:1918] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 23:20:01.213769 11068 log.cc:1196] T eed57f375a614f5d9c639c2df6d9c32f P c067c1e31b7c4fd19544fa1d400045dc: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786317539151495-1966-0/minicluster-data/ts-0/wal/wals/eed57f375a614f5d9c639c2df6d9c32f
I20260809 23:20:01.217021 10398 catalog_manager.cc:4841] TS 286c7e3876d449cc82a589d1cd8ce568 (127.1.235.131:42325): tablet eed57f375a614f5d9c639c2df6d9c32f (table test-table [id=8b52dd446f6a41e182856767ec0ef567]) successfully deleted
I20260809 23:20:01.217365 10396 catalog_manager.cc:4841] TS 3b204b786cbd45f0a263dc1d06c0577d (127.1.235.130:46781): tablet eed57f375a614f5d9c639c2df6d9c32f (table test-table [id=8b52dd446f6a41e182856767ec0ef567]) successfully deleted
W20260809 23:20:01.223135 10395 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.235.129:37415 (error 108)
I20260809 23:20:01.223452 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 10653
I20260809 23:20:01.224560 11108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:01.223616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:37415 (local address 127.0.0.1:41912)
0809 23:20:01.224432 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:01.224509 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.129:37415: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":798,"thread_start_us":43,"threads_started":1}
W20260809 23:20:01.224658 10395 catalog_manager.cc:4584] TS c067c1e31b7c4fd19544fa1d400045dc (127.1.235.129:37415): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet eed57f375a614f5d9c639c2df6d9c32f: Network error: Client connection negotiation failed: client connection to 127.1.235.129:37415: connect: Connection refused (error 111)
I20260809 23:20:01.232553 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 10810
I20260809 23:20:01.239107 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 10376
2026-08-09T23:20:01Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2974 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:20:01 dist-test-slave-6nmv krb5kdc[11111](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:20:01 dist-test-slave-6nmv krb5kdc[11111](info): set up 2 sockets
Aug 09 23:20:01 dist-test-slave-6nmv krb5kdc[11111](info): commencing operation
krb5kdc: starting...
W20260809 23:20:02.273842 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.012s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:20:02 dist-test-slave-6nmv krb5kdc[11111](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:20:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:20:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:20:02.390285 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:41299
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:41299
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:20:02.467684 11125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:02.467908 11125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:02.467945 11125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:02.469218 11125 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:20:02.469277 11125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:02.469303 11125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:02.469334 11125 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:20:02.469367 11125 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:20:02.470952 11125 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:41299
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:41299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11125
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:02.471233 11125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:02.471458 11125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:02.476272 11135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:02.476331 11132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:02.476272 11131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:02.476362 11125 server_base.cc:1034] running on GCE node
I20260809 23:20:02.476881 11125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:02.477186 11125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:02.478325 11125 hybrid_clock.cc:648] HybridClock initialized: now 1786317602478306 us; error 40 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T23:20:02Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1246 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:20:02 dist-test-slave-6nmv krb5kdc[11141](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:20:02 dist-test-slave-6nmv krb5kdc[11141](info): set up 2 sockets
Aug 09 23:20:02 dist-test-slave-6nmv krb5kdc[11141](info): commencing operation
krb5kdc: starting...
W20260809 23:20:03.553885 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:20:03 dist-test-slave-6nmv krb5kdc[11141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:20:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:20:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:20:03.681545 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:40661
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:40661
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:20:03.778828 11156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:03.779110 11156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:03.779156 11156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:03.780376 11156 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:20:03.780453 11156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:03.780476 11156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:03.780498 11156 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:20:03.780519 11156 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:20:03.782107 11156 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:40661
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:40661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:03.782416 11156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:03.782662 11156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:03.787822 11164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:03.787843 11162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:03.787818 11161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:03.788190 11156 server_base.cc:1034] running on GCE node
I20260809 23:20:03.788426 11156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:03.788709 11156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:03.789898 11156 hybrid_clock.cc:648] HybridClock initialized: now 1786317603789880 us; error 36 us; skew 500 ppm
Aug 09 23:20:03 dist-test-slave-6nmv krb5kdc[11141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317603, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:20:03.796079 11156 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:20:03.796558 11156 webserver.cc:460] Webserver started at http://127.1.235.190:45519/ using document root <none> and password file <none>
I20260809 23:20:03.796779 11156 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:03.796819 11156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:03.796905 11156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:20:03.798293 11156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "e42a4c12726d437eba9ea7c2efa44054"
format_stamp: "Formatted at 2026-08-09 23:20:03 on dist-test-slave-6nmv"
server_key: "0b48664876e7bfa50a27662721fcd04a"
server_key_iv: "ca0073cedd4b2fa111e8b77186d9a598"
server_key_version: "encryptionkey@0"
I20260809 23:20:03.798653 11156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "e42a4c12726d437eba9ea7c2efa44054"
format_stamp: "Formatted at 2026-08-09 23:20:03 on dist-test-slave-6nmv"
server_key: "0b48664876e7bfa50a27662721fcd04a"
server_key_iv: "ca0073cedd4b2fa111e8b77186d9a598"
server_key_version: "encryptionkey@0"
I20260809 23:20:03.799933 11156 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 23:20:03.800719 11172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:03.800912 11156 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:20:03.800976 11156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "e42a4c12726d437eba9ea7c2efa44054"
format_stamp: "Formatted at 2026-08-09 23:20:03 on dist-test-slave-6nmv"
server_key: "0b48664876e7bfa50a27662721fcd04a"
server_key_iv: "ca0073cedd4b2fa111e8b77186d9a598"
server_key_version: "encryptionkey@0"
I20260809 23:20:03.801025 11156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:03.816813 11156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:03.818837 11156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:03.818959 11156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:03.822870 11156 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:40661
I20260809 23:20:03.822937 11230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:40661 every 8 connection(s)
I20260809 23:20:03.823236 11156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:20:03.824101 11231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:03.826483 11231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054: Bootstrap starting.
I20260809 23:20:03.827060 11231 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:03.827335 11231 log.cc:824] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054: Log is configured to *not* fsync() on all Append() calls
I20260809 23:20:03.827836 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 11156
I20260809 23:20:03.827987 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:20:03.828178 1966 external_mini_cluster.cc:1428] Setting key 21624c625ccd958f200d4c0d0bd6fa60
I20260809 23:20:03.828178 11231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054: No bootstrap required, opened a new log
I20260809 23:20:03.830224 11231 raft_consensus.cc:348] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a4c12726d437eba9ea7c2efa44054" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40661 } }
I20260809 23:20:03.830389 11231 raft_consensus.cc:374] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:03.830439 11231 raft_consensus.cc:729] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42a4c12726d437eba9ea7c2efa44054, State: Initialized, Role: FOLLOWER
I20260809 23:20:03.830590 11231 consensus_queue.cc:260] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a4c12726d437eba9ea7c2efa44054" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40661 } }
I20260809 23:20:03.830673 11231 raft_consensus.cc:388] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:20:03.830717 11231 raft_consensus.cc:482] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:20:03.830763 11231 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:03.831310 11231 raft_consensus.cc:504] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a4c12726d437eba9ea7c2efa44054" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40661 } }
I20260809 23:20:03.831429 11231 leader_election.cc:302] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e42a4c12726d437eba9ea7c2efa44054; no voters:
I20260809 23:20:03.831652 11231 leader_election.cc:288] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:20:03.831667 11236 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:20:03.831815 11236 raft_consensus.cc:686] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [term 1 LEADER]: Becoming Leader. State: Replica: e42a4c12726d437eba9ea7c2efa44054, State: Running, Role: LEADER
I20260809 23:20:03.831900 11236 consensus_queue.cc:237] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a4c12726d437eba9ea7c2efa44054" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40661 } }
I20260809 23:20:03.831939 11231 sys_catalog.cc:564] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:20:03.832242 11238 sys_catalog.cc:455] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e42a4c12726d437eba9ea7c2efa44054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a4c12726d437eba9ea7c2efa44054" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40661 } } }
I20260809 23:20:03.832334 11238 sys_catalog.cc:458] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [sys.catalog]: This master's current role is: LEADER
I20260809 23:20:03.832567 11240 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:20:03.833146 11240 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:20:03.833590 11237 sys_catalog.cc:455] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e42a4c12726d437eba9ea7c2efa44054. Latest consensus state: current_term: 1 leader_uuid: "e42a4c12726d437eba9ea7c2efa44054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a4c12726d437eba9ea7c2efa44054" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40661 } } }
I20260809 23:20:03.833664 11237 sys_catalog.cc:458] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [sys.catalog]: This master's current role is: LEADER
I20260809 23:20:03.834908 11240 catalog_manager.cc:1347] Generated new cluster ID: 562fa004d5b5482f932f4ee17bf41456
I20260809 23:20:03.834971 11240 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 23:20:03 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317603, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:20:03.839866 11235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:03.828690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57872 (local address 127.1.235.190:40661)
0809 23:20:03.828907 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:03.828922 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:03.828946 (+ 24us) server_negotiation.cc:407] Connection header received
0809 23:20:03.829435 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:03.829442 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:03.829486 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:03.829633 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:03.830443 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:03.831898 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:03.833006 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:03.833583 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:03.833704 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:03.836395 (+ 2691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:03.836399 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:03.836399 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:20:03.836410 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:03.838112 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:03.838473 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:03.838476 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:03.838476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:03.838563 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:03.838777 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:03.838778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:03.838779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:03.839005 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:03.839573 (+ 568us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:03.839628 (+ 55us) server_negotiation.cc:299] Negotiation successful
0809 23:20:03.839726 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":95,"threads_started":1}
I20260809 23:20:03.840376 11240 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:20:03.841086 11240 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:20:03.847199 11240 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054: Generated new TSK 0
I20260809 23:20:03.847407 11240 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:20:03.878633 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:40661
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:20:03.967104 11261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:03.967288 11261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:03.967310 11261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:03.968400 11261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:03.968438 11261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:03.968463 11261 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:20:03.969825 11261 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:40661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11261
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:03.970072 11261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:03.970305 11261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:03.975263 11269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:03.975279 11274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:03.975270 11270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:03.975634 11261 server_base.cc:1034] running on GCE node
I20260809 23:20:03.975838 11261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:03.976104 11261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:03.977272 11261 hybrid_clock.cc:648] HybridClock initialized: now 1786317603977260 us; error 33 us; skew 500 ppm
Aug 09 23:20:03 dist-test-slave-6nmv krb5kdc[11141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317603, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:20:03.979995 11261 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:20:03.980522 11261 webserver.cc:460] Webserver started at http://127.1.235.129:35571/ using document root <none> and password file <none>
I20260809 23:20:03.980777 11261 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:03.980851 11261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:03.980979 11261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:20:03.982409 11261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "933033988949477cbb5d8c33149eed5c"
format_stamp: "Formatted at 2026-08-09 23:20:03 on dist-test-slave-6nmv"
server_key: "a77eb998ed75122de84ce9597470f3fe"
server_key_iv: "1ca944e7fd9e82f1b34552f4e46230b1"
server_key_version: "encryptionkey@0"
I20260809 23:20:03.982836 11261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "933033988949477cbb5d8c33149eed5c"
format_stamp: "Formatted at 2026-08-09 23:20:03 on dist-test-slave-6nmv"
server_key: "a77eb998ed75122de84ce9597470f3fe"
server_key_iv: "1ca944e7fd9e82f1b34552f4e46230b1"
server_key_version: "encryptionkey@0"
I20260809 23:20:03.984457 11261 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 23:20:03.985327 11282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:03.985539 11261 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:03.985641 11261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "933033988949477cbb5d8c33149eed5c"
format_stamp: "Formatted at 2026-08-09 23:20:03 on dist-test-slave-6nmv"
server_key: "a77eb998ed75122de84ce9597470f3fe"
server_key_iv: "1ca944e7fd9e82f1b34552f4e46230b1"
server_key_version: "encryptionkey@0"
I20260809 23:20:03.985719 11261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:04.002579 11261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:04.004662 11261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:04.004784 11261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:04.004967 11261 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:20:04.005300 11261 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:20:04.005347 11261 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.005453 11261 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:20:04.005483 11261 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.011485 11261 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:36651
I20260809 23:20:04.011520 11412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:36651 every 8 connection(s)
I20260809 23:20:04.011876 11261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:20:04.014917 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 11261
I20260809 23:20:04.015045 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:20:04.015282 1966 external_mini_cluster.cc:1428] Setting key 8d5493b2c75f3807c266c3735e5ad9d4
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317603, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:20:04.022027 11235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:04.012593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:51941 (local address 127.1.235.190:40661)
0809 23:20:04.012665 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:04.012667 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:04.012930 (+ 263us) server_negotiation.cc:407] Connection header received
0809 23:20:04.013397 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:04.013399 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:04.013409 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:04.013470 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:04.014449 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.015200 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.016348 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.016651 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.016738 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.019064 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:04.019066 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:04.019066 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:20:04.019075 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:04.020512 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:04.020977 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:04.020979 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:04.020979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:04.021047 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:04.021317 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:04.021319 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:04.021319 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:04.021448 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:04.021532 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:04.021805 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 23:20:04.021927 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 23:20:04.022320 11416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:04.012578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:51941)
0809 23:20:04.012768 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:04.012802 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:04.013305 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:04.013539 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:04.013543 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:04.014176 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:04.014352 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.014357 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.015296 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.015297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.016260 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.016263 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.016740 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.016741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.016830 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.017346 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:04.017354 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:04.018954 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:20:04.020618 (+ 1664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:04.020626 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:04.020628 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:04.020878 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:04.021121 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:04.021122 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:04.021123 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:04.021243 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:04.021522 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:20:04.021530 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:20:04.021669 (+ 139us) client_negotiation.cc:769] Sending connection context
0809 23:20:04.021784 (+ 115us) client_negotiation.cc:240] Negotiation successful
0809 23:20:04.021969 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":115,"threads_started":1}
I20260809 23:20:04.023058 11413 heartbeater.cc:347] Connected to a master server at 127.1.235.190:40661
I20260809 23:20:04.023149 11413 heartbeater.cc:464] Registering TS with master...
I20260809 23:20:04.023345 11413 heartbeater.cc:511] Master 127.1.235.190:40661 requested a full tablet report, sending...
I20260809 23:20:04.023939 11191 ts_manager.cc:194] Registered new tserver with Master: 933033988949477cbb5d8c33149eed5c (127.1.235.129:36651)
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
I20260809 23:20:04.024614 11191 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:51941
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:20:04.042209 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:40661
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:20:04.124071 11420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:04.124294 11420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:04.124318 11420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:04.125520 11420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:04.125562 11420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:04.125593 11420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:20:04.127141 11420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:40661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:04.127388 11420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:04.127632 11420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:04.132717 11428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:04.132755 11426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:04.132893 11420 server_base.cc:1034] running on GCE node
W20260809 23:20:04.132755 11425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:04.133240 11420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:04.133513 11420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:04.134676 11420 hybrid_clock.cc:648] HybridClock initialized: now 1786317604134663 us; error 48 us; skew 500 ppm
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317604, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:20:04.137256 11420 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:20:04.137705 11420 webserver.cc:460] Webserver started at http://127.1.235.130:44643/ using document root <none> and password file <none>
I20260809 23:20:04.137965 11420 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:04.138012 11420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:04.138105 11420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:20:04.139108 11420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "74b78d6b00ca4cdab44464e1016aa226"
format_stamp: "Formatted at 2026-08-09 23:20:04 on dist-test-slave-6nmv"
server_key: "679f0c01c6354fdd8b626c5b0a5c5cc7"
server_key_iv: "46b740f43795edc7870e37e44bb5bd0c"
server_key_version: "encryptionkey@0"
I20260809 23:20:04.139432 11420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "74b78d6b00ca4cdab44464e1016aa226"
format_stamp: "Formatted at 2026-08-09 23:20:04 on dist-test-slave-6nmv"
server_key: "679f0c01c6354fdd8b626c5b0a5c5cc7"
server_key_iv: "46b740f43795edc7870e37e44bb5bd0c"
server_key_version: "encryptionkey@0"
I20260809 23:20:04.140697 11420 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:20:04.141335 11438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.141556 11420 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:20:04.141670 11420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "74b78d6b00ca4cdab44464e1016aa226"
format_stamp: "Formatted at 2026-08-09 23:20:04 on dist-test-slave-6nmv"
server_key: "679f0c01c6354fdd8b626c5b0a5c5cc7"
server_key_iv: "46b740f43795edc7870e37e44bb5bd0c"
server_key_version: "encryptionkey@0"
I20260809 23:20:04.141744 11420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:04.157923 11420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:04.160360 11420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:04.160532 11420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:04.160794 11420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:20:04.161131 11420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:20:04.161185 11420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.161222 11420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:20:04.161263 11420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.167132 11420 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:32991
I20260809 23:20:04.167191 11563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:32991 every 8 connection(s)
I20260809 23:20:04.167536 11420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317604, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:20:04.176930 11235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:04.168367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:58613 (local address 127.1.235.190:40661)
0809 23:20:04.168463 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:04.168465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:04.168647 (+ 182us) server_negotiation.cc:407] Connection header received
0809 23:20:04.169174 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:04.169176 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:04.169190 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:04.169236 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:04.170263 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.170821 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.171844 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.172068 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.172156 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.174267 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:04.174269 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:04.174269 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:20:04.174277 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:04.175471 (+ 1194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:04.175911 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:04.175912 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:04.175912 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:04.175972 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:04.176246 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:04.176247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:04.176247 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:04.176365 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:04.176441 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:04.176706 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 23:20:04.176805 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 23:20:04.177100 11566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:04.168334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:58613)
0809 23:20:04.168521 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:04.168556 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:04.169064 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:04.169323 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:04.169326 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:04.169967 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:04.170159 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.170165 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.170941 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.170946 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.171750 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.171752 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.172167 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.172168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.172288 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.172785 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:04.172793 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:04.174168 (+ 1375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:20:04.175575 (+ 1407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:04.175582 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:04.175584 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:04.175804 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:04.176040 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:04.176041 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:04.176042 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:04.176168 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:04.176432 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:20:04.176439 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:20:04.176576 (+ 137us) client_negotiation.cc:769] Sending connection context
0809 23:20:04.176684 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 23:20:04.176871 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":86,"threads_started":1}
I20260809 23:20:04.177629 11564 heartbeater.cc:347] Connected to a master server at 127.1.235.190:40661
I20260809 23:20:04.177699 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 11420
I20260809 23:20:04.177735 11564 heartbeater.cc:464] Registering TS with master...
I20260809 23:20:04.177810 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:20:04.178000 11564 heartbeater.cc:511] Master 127.1.235.190:40661 requested a full tablet report, sending...
I20260809 23:20:04.178071 1966 external_mini_cluster.cc:1428] Setting key 4db5262bec1f65f7a1484671207676ed
I20260809 23:20:04.178407 11191 ts_manager.cc:194] Registered new tserver with Master: 74b78d6b00ca4cdab44464e1016aa226 (127.1.235.130:32991)
I20260809 23:20:04.179005 11191 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:58613
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:20:04.204175 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:40661
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:20:04.290120 11570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:04.290330 11570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:04.290354 11570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:04.291499 11570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:04.291544 11570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:04.291596 11570 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:20:04.293079 11570 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:40661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:04.293331 11570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:04.293589 11570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 23:20:04.298746 11570 server_base.cc:1034] running on GCE node
W20260809 23:20:04.298712 11579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:04.298733 11575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:04.298718 11577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:04.299135 11570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:04.299424 11570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:04.300572 11570 hybrid_clock.cc:648] HybridClock initialized: now 1786317604300563 us; error 28 us; skew 500 ppm
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317604, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:20:04.303081 11570 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:20:04.303622 11570 webserver.cc:460] Webserver started at http://127.1.235.131:37043/ using document root <none> and password file <none>
I20260809 23:20:04.303808 11570 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:04.303848 11570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:04.303936 11570 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:20:04.305051 11570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "67e695793f9248878a8be2996452a094"
format_stamp: "Formatted at 2026-08-09 23:20:04 on dist-test-slave-6nmv"
server_key: "d7b608245619052b740dd0a6e999c39d"
server_key_iv: "ae28d315314a0add804341a581b2c5cb"
server_key_version: "encryptionkey@0"
I20260809 23:20:04.305351 11570 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "67e695793f9248878a8be2996452a094"
format_stamp: "Formatted at 2026-08-09 23:20:04 on dist-test-slave-6nmv"
server_key: "d7b608245619052b740dd0a6e999c39d"
server_key_iv: "ae28d315314a0add804341a581b2c5cb"
server_key_version: "encryptionkey@0"
I20260809 23:20:04.306792 11570 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:20:04.307530 11588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.307693 11570 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.307762 11570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "67e695793f9248878a8be2996452a094"
format_stamp: "Formatted at 2026-08-09 23:20:04 on dist-test-slave-6nmv"
server_key: "d7b608245619052b740dd0a6e999c39d"
server_key_iv: "ae28d315314a0add804341a581b2c5cb"
server_key_version: "encryptionkey@0"
I20260809 23:20:04.307816 11570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:04.316982 11570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:04.318764 11570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:04.318868 11570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:04.319053 11570 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:20:04.319294 11570 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:20:04.319324 11570 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.319344 11570 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:20:04.319356 11570 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.325100 11570 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:46417
I20260809 23:20:04.325143 11713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:46417 every 8 connection(s)
I20260809 23:20:04.325469 11570 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:20:04.329778 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 11570
I20260809 23:20:04.329936 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:20:04.330147 1966 external_mini_cluster.cc:1428] Setting key fd9c220e7c332f015e27fa8cc3b3e9b7
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317604, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:20:04.335052 11235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:04.326168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:46815 (local address 127.1.235.190:40661)
0809 23:20:04.326228 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:04.326229 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:04.326400 (+ 171us) server_negotiation.cc:407] Connection header received
0809 23:20:04.326852 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:04.326853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:04.326862 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:04.326928 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:04.327771 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.328343 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.329528 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.329842 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.329926 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.332300 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:04.332302 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:04.332302 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:20:04.332309 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:04.333600 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:04.334061 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:04.334063 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:04.334063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:04.334132 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:04.334399 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:04.334400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:04.334400 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:04.334516 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:04.334608 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:04.334879 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 23:20:04.334961 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 23:20:04.335249 11716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:04.326119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:46815)
0809 23:20:04.326280 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:04.326319 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:04.326776 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:04.326997 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:04.327001 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:04.327527 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:04.327704 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.327708 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.328442 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.328443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.329440 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.329442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.329997 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.329998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.330145 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.330719 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:04.330727 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:04.332199 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:20:04.333698 (+ 1499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:04.333705 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:04.333707 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:04.333992 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:04.334202 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:04.334203 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:04.334203 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:04.334326 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:04.334602 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:20:04.334609 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:20:04.334745 (+ 136us) client_negotiation.cc:769] Sending connection context
0809 23:20:04.334846 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 23:20:04.335006 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":95,"threads_started":1}
I20260809 23:20:04.335731 11714 heartbeater.cc:347] Connected to a master server at 127.1.235.190:40661
I20260809 23:20:04.335825 11714 heartbeater.cc:464] Registering TS with master...
I20260809 23:20:04.336000 11714 heartbeater.cc:511] Master 127.1.235.190:40661 requested a full tablet report, sending...
I20260809 23:20:04.336349 11191 ts_manager.cc:194] Registered new tserver with Master: 67e695793f9248878a8be2996452a094 (127.1.235.131:46417)
I20260809 23:20:04.336663 11191 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:46815
I20260809 23:20:04.341825 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.129.keytab.
Entry for principal oryx/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.129.keytab.
WARNING: no policy specified for oryx/127.1.235.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.130.keytab.
Entry for principal oryx/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.130.keytab.
WARNING: no policy specified for oryx/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.131.keytab.
Entry for principal oryx/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.131.keytab.
I20260809 23:20:04.416744 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 11261
I20260809 23:20:04.423058 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 11420
I20260809 23:20:04.430305 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 11570
I20260809 23:20:04.435420 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 11156
I20260809 23:20:04.441610 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:40661
--webserver_interface=127.1.235.190
--webserver_port=45519
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:40661
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:20:04.525368 11723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:04.525568 11723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:04.525590 11723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:04.526733 11723 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:20:04.526774 11723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:04.526788 11723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:04.526800 11723 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:20:04.526858 11723 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:20:04.528262 11723 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:40661
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:40661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=45519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:04.528513 11723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:04.528765 11723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:04.533782 11729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:04.533775 11728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:04.533775 11731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:04.533890 11723 server_base.cc:1034] running on GCE node
I20260809 23:20:04.534281 11723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:04.534523 11723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:04.535696 11723 hybrid_clock.cc:648] HybridClock initialized: now 1786317604535671 us; error 43 us; skew 500 ppm
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317604, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:20:04.538182 11723 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:20:04.538631 11723 webserver.cc:460] Webserver started at http://127.1.235.190:45519/ using document root <none> and password file <none>
I20260809 23:20:04.538866 11723 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:04.538975 11723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:04.540424 11723 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:20:04.541131 11740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.541333 11723 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:04.541441 11723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "e42a4c12726d437eba9ea7c2efa44054"
format_stamp: "Formatted at 2026-08-09 23:20:03 on dist-test-slave-6nmv"
server_key: "0b48664876e7bfa50a27662721fcd04a"
server_key_iv: "ca0073cedd4b2fa111e8b77186d9a598"
server_key_version: "encryptionkey@0"
I20260809 23:20:04.541796 11723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:04.564950 11723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:04.567104 11723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:04.567272 11723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:04.571264 11723 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:40661
I20260809 23:20:04.571339 11796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:40661 every 8 connection(s)
I20260809 23:20:04.571738 11723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:20:04.573240 11797 sys_catalog.cc:263] Verifying existing consensus state
I20260809 23:20:04.573985 11797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054: Bootstrap starting.
I20260809 23:20:04.577158 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 11723
I20260809 23:20:04.577457 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:36651
--local_ip_for_outbound_sockets=127.1.235.129
--tserver_master_addrs=127.1.235.190:40661
--webserver_port=35571
--webserver_interface=127.1.235.129
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.1.235.129
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:20:04.583427 11797 log.cc:824] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054: Log is configured to *not* fsync() on all Append() calls
I20260809 23:20:04.585054 11797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 23:20:04.585363 11797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054: Bootstrap complete.
I20260809 23:20:04.587718 11797 raft_consensus.cc:348] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a4c12726d437eba9ea7c2efa44054" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40661 } }
I20260809 23:20:04.587930 11797 raft_consensus.cc:729] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42a4c12726d437eba9ea7c2efa44054, State: Initialized, Role: FOLLOWER
I20260809 23:20:04.588101 11797 consensus_queue.cc:260] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a4c12726d437eba9ea7c2efa44054" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40661 } }
I20260809 23:20:04.588184 11797 raft_consensus.cc:388] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:20:04.588231 11797 raft_consensus.cc:482] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:20:04.588279 11797 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [term 1 FOLLOWER]: Advancing to term 2
I20260809 23:20:04.589264 11797 raft_consensus.cc:504] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a4c12726d437eba9ea7c2efa44054" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40661 } }
I20260809 23:20:04.589375 11797 leader_election.cc:302] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e42a4c12726d437eba9ea7c2efa44054; no voters:
I20260809 23:20:04.589597 11797 leader_election.cc:288] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 23:20:04.589630 11801 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 23:20:04.589746 11801 raft_consensus.cc:686] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [term 2 LEADER]: Becoming Leader. State: Replica: e42a4c12726d437eba9ea7c2efa44054, State: Running, Role: LEADER
I20260809 23:20:04.589854 11801 consensus_queue.cc:237] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a4c12726d437eba9ea7c2efa44054" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40661 } }
I20260809 23:20:04.589883 11797 sys_catalog.cc:564] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:20:04.590135 11802 sys_catalog.cc:455] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e42a4c12726d437eba9ea7c2efa44054. Latest consensus state: current_term: 2 leader_uuid: "e42a4c12726d437eba9ea7c2efa44054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a4c12726d437eba9ea7c2efa44054" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40661 } } }
I20260809 23:20:04.590226 11802 sys_catalog.cc:458] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [sys.catalog]: This master's current role is: LEADER
I20260809 23:20:04.590427 11807 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:20:04.591039 11807 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:20:04.591228 11807 catalog_manager.cc:1259] Loaded cluster ID: 562fa004d5b5482f932f4ee17bf41456
I20260809 23:20:04.591270 11807 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:20:04.591496 11803 sys_catalog.cc:455] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e42a4c12726d437eba9ea7c2efa44054" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e42a4c12726d437eba9ea7c2efa44054" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40661 } } }
I20260809 23:20:04.591572 11803 sys_catalog.cc:458] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054 [sys.catalog]: This master's current role is: LEADER
I20260809 23:20:04.592279 11807 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:20:04.592458 11807 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e42a4c12726d437eba9ea7c2efa44054: Loaded TSK: 0
I20260809 23:20:04.592667 11807 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 23:20:04.664687 11799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:04.664875 11799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:04.664899 11799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:04.666116 11799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:04.666157 11799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:04.666182 11799 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:20:04.667613 11799 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.129.keytab
--principal=oryx/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:36651
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=35571
--tserver_master_addrs=127.1.235.190:40661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:04.667835 11799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:04.668081 11799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:04.673979 11828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:04.673990 11829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:04.674283 11831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:04.674257 11799 server_base.cc:1034] running on GCE node
I20260809 23:20:04.674471 11799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:04.674758 11799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:04.675913 11799 hybrid_clock.cc:648] HybridClock initialized: now 1786317604675903 us; error 27 us; skew 500 ppm
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317604, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:20:04.678695 11799 init.cc:377] Logged in from keytab as oryx/127.1.235.129@KRBTEST.COM (short username oryx)
I20260809 23:20:04.679234 11799 webserver.cc:460] Webserver started at http://127.1.235.129:35571/ using document root <none> and password file <none>
I20260809 23:20:04.679509 11799 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:04.679596 11799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:04.681361 11799 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:20:04.682072 11840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.682293 11799 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:04.682390 11799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "933033988949477cbb5d8c33149eed5c"
format_stamp: "Formatted at 2026-08-09 23:20:03 on dist-test-slave-6nmv"
server_key: "a77eb998ed75122de84ce9597470f3fe"
server_key_iv: "1ca944e7fd9e82f1b34552f4e46230b1"
server_key_version: "encryptionkey@0"
I20260809 23:20:04.682812 11799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:04.699757 11799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:04.702229 11799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:04.702382 11799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:04.702667 11799 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:20:04.703018 11799 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:20:04.703099 11799 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.703133 11799 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:20:04.703151 11799 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.710631 11799 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:36651
I20260809 23:20:04.710726 11966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:36651 every 8 connection(s)
I20260809 23:20:04.711090 11799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:20:04.713236 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 11799
I20260809 23:20:04.713546 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:32991
--local_ip_for_outbound_sockets=127.1.235.130
--tserver_master_addrs=127.1.235.190:40661
--webserver_port=44643
--webserver_interface=127.1.235.130
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.1.235.130
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:04.721481 11969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:04.711850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:54177)
0809 23:20:04.712031 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:04.712073 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:04.712586 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:04.713051 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:04.713054 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:04.713785 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:04.714014 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.714020 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.715242 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.715243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.716549 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.716552 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.717397 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.717399 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.717549 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.718188 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:04.718199 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:04.721232 (+ 3033us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":105,"threads_started":1}
W20260809 23:20:04.721747 11967 heartbeater.cc:644] Failed to heartbeat to 127.1.235.190:40661 (0 consecutive failures): Not authorized: Failed to ping master at 127.1.235.190:40661: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
W20260809 23:20:04.721971 11970 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:04.711929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:54177 (local address 127.1.235.190:40661)
0809 23:20:04.712168 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:04.712175 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:04.712217 (+ 42us) server_negotiation.cc:407] Connection header received
0809 23:20:04.712796 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:04.712804 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:04.712852 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:04.712981 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:04.714143 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.715105 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.716665 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.717273 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.717385 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.721414 (+ 4029us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:54177: BlockingRecv error: recv got EOF from 127.1.235.129:54177 (error 108)
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":94,"threads_started":1}
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:04.728138 11969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:04.722011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:54297)
0809 23:20:04.722359 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:04.722371 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:04.722431 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:04.722576 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:04.722577 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:04.722750 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:04.722810 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.722812 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.723750 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.723751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.724672 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.724675 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.725226 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.725228 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.725305 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.725776 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:04.725781 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:04.728066 (+ 2285us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":85,"threads_started":1}
W20260809 23:20:04.728430 11970 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:04.722212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:54297 (local address 127.1.235.190:40661)
0809 23:20:04.722243 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:04.722245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:04.722431 (+ 186us) server_negotiation.cc:407] Connection header received
0809 23:20:04.722496 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:04.722496 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:04.722509 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:04.722571 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:04.722892 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.723647 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.724775 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.725135 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.725208 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.728353 (+ 3145us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:54297: BlockingRecv error: recv got EOF from 127.1.235.129:54297 (error 108)
Metrics: {"server-negotiator.queue_time_us":14,"thread_start_us":87,"threads_started":1}
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:04.733855 11969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:04.728357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:52865)
0809 23:20:04.728479 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:04.728488 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:04.728535 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:04.728811 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:04.728812 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:04.728964 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:04.729001 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.729003 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.729938 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.729939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.730739 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.730741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.731211 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.731211 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.731267 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.731728 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:04.731733 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:04.733750 (+ 2017us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111}
W20260809 23:20:04.733960 11973 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:04.728440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:52865 (local address 127.1.235.190:40661)
0809 23:20:04.728618 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:04.728620 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:04.728627 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:20:04.728647 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:04.728647 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:04.728656 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:04.728772 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:04.729089 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.729859 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.730829 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.731130 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.731199 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.733903 (+ 2704us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:52865: BlockingRecv error: recv got EOF from 127.1.235.129:52865 (error 108)
Metrics: {"server-negotiator.queue_time_us":151}
W20260809 23:20:04.734241 11967 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 23:20:04.796958 11971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:04.797140 11971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:04.797163 11971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:04.798264 11971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:04.798300 11971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:04.798322 11971 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:20:04.799635 11971 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.130.keytab
--principal=oryx/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:32991
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=44643
--tserver_master_addrs=127.1.235.190:40661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11971
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:04.799862 11971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:04.800065 11971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 23:20:04.804740 11971 server_base.cc:1034] running on GCE node
W20260809 23:20:04.804713 11978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:04.804716 11981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:04.804708 11983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:04.805146 11971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:04.805338 11971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:04.806464 11971 hybrid_clock.cc:648] HybridClock initialized: now 1786317604806452 us; error 35 us; skew 500 ppm
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317604, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:20:04.808787 11971 init.cc:377] Logged in from keytab as oryx/127.1.235.130@KRBTEST.COM (short username oryx)
I20260809 23:20:04.809165 11971 webserver.cc:460] Webserver started at http://127.1.235.130:44643/ using document root <none> and password file <none>
I20260809 23:20:04.809329 11971 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:04.809377 11971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:04.810613 11971 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:04.811113 11990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.811271 11971 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:20:04.811345 11971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "74b78d6b00ca4cdab44464e1016aa226"
format_stamp: "Formatted at 2026-08-09 23:20:04 on dist-test-slave-6nmv"
server_key: "679f0c01c6354fdd8b626c5b0a5c5cc7"
server_key_iv: "46b740f43795edc7870e37e44bb5bd0c"
server_key_version: "encryptionkey@0"
I20260809 23:20:04.811597 11971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:04.827497 11971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:04.829015 11971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:04.829102 11971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:04.829237 11971 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:20:04.829430 11971 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:20:04.829455 11971 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.829473 11971 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:20:04.829483 11971 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.834617 11971 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:32991
I20260809 23:20:04.834699 12114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:32991 every 8 connection(s)
I20260809 23:20:04.835009 11971 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:20:04.839200 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 11971
I20260809 23:20:04.839471 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:46417
--local_ip_for_outbound_sockets=127.1.235.131
--tserver_master_addrs=127.1.235.190:40661
--webserver_port=37043
--webserver_interface=127.1.235.131
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.1.235.131
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 23:20:04.842254 11973 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:04.835712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:39629 (local address 127.1.235.190:40661)
0809 23:20:04.835782 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:04.835796 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:04.835982 (+ 186us) server_negotiation.cc:407] Connection header received
0809 23:20:04.836405 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:04.836406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:04.836424 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:04.836504 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:04.837331 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.837856 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.838813 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.839007 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.839126 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.842209 (+ 3083us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:39629: BlockingRecv error: recv got EOF from 127.1.235.130:39629 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 23:20:04.842299 12117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:04.835704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:39629)
0809 23:20:04.835872 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:04.835905 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:04.836302 (+ 397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:04.836566 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:04.836569 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:04.837079 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:04.837235 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.837239 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.837976 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.837977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.838695 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.838697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.839133 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.839134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.839259 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.839746 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:04.839753 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:04.842125 (+ 2372us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":110,"threads_started":1}
W20260809 23:20:04.842520 12115 heartbeater.cc:644] Failed to heartbeat to 127.1.235.190:40661 (0 consecutive failures): Not authorized: Failed to ping master at 127.1.235.190:40661: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:04.846927 12117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:04.842716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:41561)
0809 23:20:04.842770 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:04.842779 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:04.842816 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:04.842932 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:04.842933 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:04.843047 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:04.843083 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.843084 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.843654 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.843655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.844223 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.844225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.844651 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.844652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.844723 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.845206 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:04.845211 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:04.846883 (+ 1672us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":39}
W20260809 23:20:04.847071 11973 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:04.842778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:41561 (local address 127.1.235.190:40661)
0809 23:20:04.842817 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:04.842819 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:04.842827 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:20:04.842867 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:04.842868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:04.842877 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:04.842917 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:04.843155 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.843576 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.844333 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.844579 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.844653 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.846996 (+ 2343us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:41561: BlockingRecv error: recv got EOF from 127.1.235.130:41561 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:04.851107 12117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:04.847296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:48991)
0809 23:20:04.847343 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:04.847353 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:04.847392 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:04.847501 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:04.847501 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:04.847620 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:04.847640 (+ 20us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.847641 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.848193 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.848194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.848656 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.848657 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.849015 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.849016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.849073 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.849460 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:04.849464 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:04.851040 (+ 1576us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 23:20:04.851162 11973 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:04.847362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:48991 (local address 127.1.235.190:40661)
0809 23:20:04.847398 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:04.847400 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:04.847416 (+ 16us) server_negotiation.cc:407] Connection header received
0809 23:20:04.847437 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:04.847438 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:04.847448 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:04.847497 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:04.847716 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.848118 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.848739 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.848942 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.849017 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.851101 (+ 2084us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:48991: BlockingRecv error: recv got EOF from 127.1.235.130:48991 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 23:20:04.851344 12115 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 23:20:04.918597 12118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:04.918828 12118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:04.918883 12118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:04.920022 12118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:04.920083 12118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:04.920126 12118 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:20:04.921468 12118 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/krb5kdc/oryx_127.1.235.131.keytab
--principal=oryx/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:46417
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=37043
--tserver_master_addrs=127.1.235.190:40661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:04.921720 12118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:04.921933 12118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:04.926823 12125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:04.926797 12127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:04.926789 12124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:04.927011 12118 server_base.cc:1034] running on GCE node
I20260809 23:20:04.927166 12118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:04.927348 12118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:04.928514 12118 hybrid_clock.cc:648] HybridClock initialized: now 1786317604928491 us; error 38 us; skew 500 ppm
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317604, etypes {rep=17 tkt=17 ses=17}, oryx/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:20:04.931056 12118 init.cc:377] Logged in from keytab as oryx/127.1.235.131@KRBTEST.COM (short username oryx)
I20260809 23:20:04.931453 12118 webserver.cc:460] Webserver started at http://127.1.235.131:37043/ using document root <none> and password file <none>
I20260809 23:20:04.931701 12118 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:04.931777 12118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:04.933074 12118 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:04.933669 12134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.933905 12118 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:04.934005 12118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "67e695793f9248878a8be2996452a094"
format_stamp: "Formatted at 2026-08-09 23:20:04 on dist-test-slave-6nmv"
server_key: "d7b608245619052b740dd0a6e999c39d"
server_key_iv: "ae28d315314a0add804341a581b2c5cb"
server_key_version: "encryptionkey@0"
I20260809 23:20:04.934341 12118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:04.952457 12118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:04.954097 12118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:04.954236 12118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:04.954478 12118 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:20:04.954782 12118 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:20:04.954838 12118 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.954880 12118 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:20:04.954908 12118 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:04.960340 12118 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:46417
I20260809 23:20:04.960417 12259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:46417 every 8 connection(s)
I20260809 23:20:04.960721 12118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:20:04.965333 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 12118
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
W20260809 23:20:04.967423 11973 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:04.961355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:53741 (local address 127.1.235.190:40661)
0809 23:20:04.961409 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:04.961413 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:04.961595 (+ 182us) server_negotiation.cc:407] Connection header received
0809 23:20:04.962143 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:04.962144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:04.962153 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:04.962205 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:04.963027 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.963467 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.964320 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.964506 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.964558 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.967371 (+ 2813us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.131:53741: BlockingRecv error: recv got EOF from 127.1.235.131:53741 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 23:20:04.967476 12263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:04.961318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:53741)
0809 23:20:04.961469 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:04.961506 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:04.962048 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:04.962275 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:04.962278 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:04.962788 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:04.962948 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.962952 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.963538 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.963538 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.964231 (+ 693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.964232 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.964578 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.964579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.964678 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.965081 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:04.965097 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:04.967301 (+ 2204us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":84,"threads_started":1}
W20260809 23:20:04.967695 12261 heartbeater.cc:644] Failed to heartbeat to 127.1.235.190:40661 (0 consecutive failures): Not authorized: Failed to ping master at 127.1.235.190:40661: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:04.971700 12263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:04.967901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:56967)
0809 23:20:04.967944 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:04.967953 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:04.968011 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:04.968126 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:04.968126 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:04.968239 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:04.968274 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.968275 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.968810 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.968811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.969275 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.969276 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.969628 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.969629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.969700 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.970173 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:04.970177 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:04.971616 (+ 1439us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":29}
W20260809 23:20:04.971752 11973 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:04.967961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:56967 (local address 127.1.235.190:40661)
0809 23:20:04.968014 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:04.968015 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:04.968023 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:20:04.968063 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:04.968064 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:04.968072 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:04.968121 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:04.968350 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.968740 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.969354 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.969546 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.969625 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.971694 (+ 2069us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.131:56967: BlockingRecv error: recv got EOF from 127.1.235.131:56967 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 23:20:04.972764 11970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:04.965917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45280 (local address 127.1.235.190:40661)
0809 23:20:04.965967 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:04.965970 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:04.965979 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:20:04.966036 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:04.966037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:04.966048 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:04.966092 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:04.966769 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.967183 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.968046 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.968221 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.968299 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.969432 (+ 1133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:04.969436 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:04.969437 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:20:04.969447 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:04.971145 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:04.971484 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:04.971486 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:04.971487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:04.971574 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:04.971948 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:04.971949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:04.971949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:04.972251 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:04.972381 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:04.972551 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 23:20:04.972679 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:04 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:04.976071 12263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:04.972063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:47889)
0809 23:20:04.972113 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:04.972125 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:04.972165 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:04.972275 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:04.972276 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:04.972437 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:04.972465 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.972467 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.973249 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.973250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.973926 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:04.973928 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.974235 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.974236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:04.974272 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.974582 (+ 310us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:04.974585 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:04.976036 (+ 1451us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 23:20:04.976181 11973 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:04.972134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:47889 (local address 127.1.235.190:40661)
0809 23:20:04.972173 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:04.972175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:04.972185 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:20:04.972204 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:04.972204 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:04.972213 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:04.972273 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:04.972532 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.973135 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.974005 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:04.974176 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:04.974227 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:04.976119 (+ 1892us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.131:47889: BlockingRecv error: recv got EOF from 127.1.235.131:47889 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 23:20:04.976186 12261 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 23:20:05 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:05 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:05.739277 12265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:05.734652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:42609)
0809 23:20:05.734771 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:05.734781 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:05.734826 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:05.734947 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:05.734948 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:05.735104 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:05.735152 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:05.735153 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:05.735841 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:05.735842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:05.736526 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:05.736529 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:05.736877 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:05.736878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:05.736935 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:05.737355 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:05.737361 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:05.739206 (+ 1845us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":63,"threads_started":1}
W20260809 23:20:05.739461 12266 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:05.734708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:42609 (local address 127.1.235.190:40661)
0809 23:20:05.734839 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:05.734840 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:05.734848 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:20:05.734869 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:05.734869 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:05.734879 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:05.734938 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:05.735211 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:05.735744 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:05.736609 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:05.736807 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:05.736863 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:05.739340 (+ 2477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:42609: BlockingRecv error: recv got EOF from 127.1.235.129:42609 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":80,"threads_started":1}
Aug 09 23:20:05 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:05 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:05.856062 12267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:05.851799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:33987)
0809 23:20:05.851950 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:05.851961 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:05.852019 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:05.852137 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:05.852138 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:05.852296 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:05.852345 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:05.852346 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:05.852972 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:05.852972 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:05.853436 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:05.853437 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:05.853714 (+ 277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:05.853714 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:05.853749 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:05.854255 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:05.854260 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:05.856001 (+ 1741us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":69,"threads_started":1}
W20260809 23:20:05.856185 12266 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:05.851862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:33987 (local address 127.1.235.190:40661)
0809 23:20:05.851960 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:05.851962 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:05.852007 (+ 45us) server_negotiation.cc:407] Connection header received
0809 23:20:05.852060 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:05.852061 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:05.852071 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:05.852117 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:05.852410 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:05.852897 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:05.853505 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:05.853661 (+ 156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:05.853702 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:05.856112 (+ 2410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:33987: BlockingRecv error: recv got EOF from 127.1.235.130:33987 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 09 23:20:05 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:05 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:05.980957 12268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:05.976518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:33391)
0809 23:20:05.976716 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:05.976727 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:05.976810 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:05.976954 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:05.976955 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:05.977130 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:05.977174 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:05.977175 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:05.977791 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:05.977792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:05.978360 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:05.978362 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:05.978697 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:05.978698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:05.978752 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:05.979177 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:05.979181 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:05.980899 (+ 1718us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":89,"threads_started":1}
W20260809 23:20:05.981060 12266 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:05.976601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:33391 (local address 127.1.235.190:40661)
0809 23:20:05.976695 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:05.976697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:05.976791 (+ 94us) server_negotiation.cc:407] Connection header received
0809 23:20:05.976869 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:05.976870 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:05.976888 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:05.976947 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:05.977245 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:05.977706 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:05.978443 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:05.978617 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:05.978695 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:05.980991 (+ 2296us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.131:33391: BlockingRecv error: recv got EOF from 127.1.235.131:33391 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 09 23:20:06 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:06 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:06.744343 12269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:06.739693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:59873)
0809 23:20:06.739893 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:06.739903 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:06.739962 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:06.740069 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:06.740070 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:06.740224 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:06.740273 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:06.740274 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:06.740907 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:06.740908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:06.741460 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:06.741462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:06.741786 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:06.741787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:06.741858 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:06.742312 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:06.742317 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:06.744250 (+ 1933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":129,"threads_started":1}
W20260809 23:20:06.744534 12271 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:06.739798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:59873 (local address 127.1.235.190:40661)
0809 23:20:06.739898 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:06.739900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:06.739953 (+ 53us) server_negotiation.cc:407] Connection header received
0809 23:20:06.740003 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:06.740003 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:06.740013 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:06.740066 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:06.740330 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:06.740809 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:06.741533 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:06.741719 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:06.741768 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:06.744346 (+ 2578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:59873: BlockingRecv error: recv got EOF from 127.1.235.129:59873 (error 108)
Metrics: {"server-negotiator.queue_time_us":80,"thread_start_us":50,"threads_started":1}
Aug 09 23:20:06 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:06 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:06.861238 12272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:06.856556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:53093)
0809 23:20:06.856734 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:06.856753 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:06.856834 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:06.856978 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:06.856979 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:06.857159 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:06.857209 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:06.857210 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:06.857956 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:06.857958 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:06.858492 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:06.858493 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:06.858864 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:06.858865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:06.858953 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:06.859377 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:06.859381 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:06.861137 (+ 1756us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":96,"threads_started":1}
W20260809 23:20:06.861291 12271 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:06.856604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:53093 (local address 127.1.235.190:40661)
0809 23:20:06.856699 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:06.856701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:06.856862 (+ 161us) server_negotiation.cc:407] Connection header received
0809 23:20:06.856892 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:06.856892 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:06.856904 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:06.856963 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:06.857297 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:06.857862 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:06.858578 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:06.858789 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:06.858865 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:06.861224 (+ 2359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:53093: BlockingRecv error: recv got EOF from 127.1.235.130:53093 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 09 23:20:06 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:06 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:06.986374 12273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:06.981462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:50073)
0809 23:20:06.981646 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:06.981661 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:06.981728 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:06.981927 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:06.981928 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:06.982121 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:06.982182 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:06.982184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:06.982821 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:06.982822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:06.983406 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:06.983408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:06.983802 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:06.983803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:06.983872 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:06.984392 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:06.984397 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:06.986277 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":133,"threads_started":1}
W20260809 23:20:06.986424 12271 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:06.981615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:50073 (local address 127.1.235.190:40661)
0809 23:20:06.981681 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:06.981683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:06.981709 (+ 26us) server_negotiation.cc:407] Connection header received
0809 23:20:06.981833 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:06.981834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:06.981854 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:06.981918 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:06.982265 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:06.982734 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:06.983496 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:06.983698 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:06.983802 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:06.986359 (+ 2557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.131:50073: BlockingRecv error: recv got EOF from 127.1.235.131:50073 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 09 23:20:07 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:07 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:07.749615 12274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:07.744846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:60565)
0809 23:20:07.745019 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:07.745032 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:07.745107 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:07.745249 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:07.745250 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:07.745415 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:07.745465 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:07.745466 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:07.746175 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:07.746175 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:07.746772 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:07.746775 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:07.747281 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:07.747282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:07.747325 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:07.747754 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:07.747758 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:07.749555 (+ 1797us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":98,"threads_started":1}
W20260809 23:20:07.749756 12275 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:07.744957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:60565 (local address 127.1.235.190:40661)
0809 23:20:07.745104 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:07.745106 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:07.745116 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:20:07.745157 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:07.745158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:07.745169 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:07.745225 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:07.745547 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:07.746102 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:07.746882 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:07.747212 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:07.747280 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:07.749660 (+ 2380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:60565: BlockingRecv error: recv got EOF from 127.1.235.129:60565 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":75,"threads_started":1}
Aug 09 23:20:07 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:07 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:07.866510 12276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:07.861732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:34671)
0809 23:20:07.862039 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:07.862051 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:07.862130 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:07.862275 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:07.862276 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:07.862443 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:07.862488 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:07.862489 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:07.863188 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:07.863189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:07.863699 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:07.863701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:07.864049 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:07.864050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:07.864110 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:07.864562 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:07.864573 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:07.866425 (+ 1852us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":226,"threads_started":1}
W20260809 23:20:07.866560 12275 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:07.861961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:34671 (local address 127.1.235.190:40661)
0809 23:20:07.862039 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:07.862041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:07.862105 (+ 64us) server_negotiation.cc:407] Connection header received
0809 23:20:07.862188 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:07.862189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:07.862200 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:07.862267 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:07.862569 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:07.863079 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:07.863780 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:07.863979 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:07.864051 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:07.866503 (+ 2452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:34671: BlockingRecv error: recv got EOF from 127.1.235.130:34671 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 09 23:20:07 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:07 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:07.991539 12277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:07.986853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:33897)
0809 23:20:07.986983 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:07.986998 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:07.987089 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:07.987211 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:07.987212 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:07.987401 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:07.987453 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:07.987455 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:07.988112 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:07.988112 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:07.988629 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:07.988630 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:07.988944 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:07.988945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:07.988984 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:07.989474 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:07.989478 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:07.991443 (+ 1965us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":85,"threads_started":1}
W20260809 23:20:07.991588 12275 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:07.986936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:33897 (local address 127.1.235.190:40661)
0809 23:20:07.986997 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:07.986999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:07.987082 (+ 83us) server_negotiation.cc:407] Connection header received
0809 23:20:07.987132 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:07.987132 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:07.987143 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:07.987194 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:07.987530 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:07.988040 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:07.988700 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:07.988880 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:07.988927 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:07.991514 (+ 2587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.131:33897: BlockingRecv error: recv got EOF from 127.1.235.131:33897 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 09 23:20:08 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:08 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:08.754678 12278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:08.750098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:34191)
0809 23:20:08.750248 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:08.750259 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:08.750306 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:08.750442 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:08.750443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:08.750614 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:08.750663 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:08.750665 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:08.751300 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:08.751301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:08.751849 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:08.751850 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:08.752193 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:08.752194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:08.752235 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:08.752686 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:08.752690 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:08.754582 (+ 1892us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":84,"threads_started":1}
W20260809 23:20:08.754846 12279 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:08.750169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:34191 (local address 127.1.235.190:40661)
0809 23:20:08.750290 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:08.750291 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:08.750301 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:20:08.750351 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:08.750351 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:08.750361 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:08.750423 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:08.750724 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:08.751222 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:08.751944 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:08.752133 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:08.752183 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:08.754755 (+ 2572us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:34191: BlockingRecv error: recv got EOF from 127.1.235.129:34191 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":71,"threads_started":1}
Aug 09 23:20:08 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:08 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:08.877696 12280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:08.867226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:33235)
0809 23:20:08.867372 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:08.867382 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:08.867469 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:08.867692 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:08.867693 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:08.867891 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:08.867940 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:08.867942 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:08.868547 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:08.868548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:08.869077 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:08.869079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:08.869377 (+ 298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:08.869378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:08.869415 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:08.875642 (+ 6227us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:08.875648 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:08.877635 (+ 1987us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":85,"threads_started":1}
W20260809 23:20:08.877961 12279 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:08.867308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:33235 (local address 127.1.235.190:40661)
0809 23:20:08.867370 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:08.867373 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:08.867465 (+ 92us) server_negotiation.cc:407] Connection header received
0809 23:20:08.867542 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:08.867543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:08.867557 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:08.867653 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:08.868008 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:08.868482 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:08.869146 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:08.869315 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:08.869365 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:08.877917 (+ 8552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:33235: BlockingRecv error: recv got EOF from 127.1.235.130:33235 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 09 23:20:08 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:08 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:08.996858 12281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:08.992061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:36573)
0809 23:20:08.992249 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:08.992260 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:08.992350 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:08.992488 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:08.992488 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:08.992689 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:08.992738 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:08.992740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:08.993424 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:08.993425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:08.993972 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:08.993974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:08.994332 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:08.994333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:08.994388 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:08.994930 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:08.994936 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:08.996769 (+ 1833us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":100,"threads_started":1}
W20260809 23:20:08.997061 12279 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:08.992158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:36573 (local address 127.1.235.190:40661)
0809 23:20:08.992237 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:08.992239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:08.992334 (+ 95us) server_negotiation.cc:407] Connection header received
0809 23:20:08.992410 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:08.992411 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:08.992425 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:08.992473 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:08.992833 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:08.993333 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:08.994058 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:08.994254 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:08.994337 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:08.996935 (+ 2598us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.131:36573: BlockingRecv error: recv got EOF from 127.1.235.131:36573 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 09 23:20:09 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:09 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:09.760392 12282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:09.755182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:34143)
0809 23:20:09.755438 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:09.755449 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:09.755515 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:09.755672 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:09.755673 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:09.755860 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:09.755918 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:09.755920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:09.756923 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:09.756925 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:09.757452 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:09.757454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:09.757878 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:09.757879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:09.757930 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:09.758408 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:09.758412 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:09.760311 (+ 1899us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":188,"threads_started":1}
W20260809 23:20:09.760515 12283 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:09.755245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:34143 (local address 127.1.235.190:40661)
0809 23:20:09.755408 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:09.755410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:09.755510 (+ 100us) server_negotiation.cc:407] Connection header received
0809 23:20:09.755571 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:09.755572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:09.755582 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:09.755647 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:09.756025 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:09.756825 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:09.757561 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:09.757759 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:09.757862 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:09.760421 (+ 2559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:34143: BlockingRecv error: recv got EOF from 127.1.235.129:34143 (error 108)
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":104,"threads_started":1}
Aug 09 23:20:09 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:09 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:09.882331 12284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:09.878223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:54639)
0809 23:20:09.878388 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:09.878405 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:09.878457 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:09.878573 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:09.878573 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:09.878728 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:09.878777 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:09.878778 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:09.879385 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:09.879386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:09.879864 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:09.879865 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:09.880154 (+ 289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:09.880155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:09.880190 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:09.880599 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:09.880603 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:09.882276 (+ 1673us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":55,"threads_started":1}
W20260809 23:20:09.882411 12283 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:09.878396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:54639 (local address 127.1.235.190:40661)
0809 23:20:09.878464 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:09.878466 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:09.878476 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:20:09.878499 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:09.878499 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:09.878509 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:09.878557 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:09.878839 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:09.879314 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:09.879929 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:09.880100 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:09.880144 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:09.882365 (+ 2221us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:54639: BlockingRecv error: recv got EOF from 127.1.235.130:54639 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 09 23:20:09 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:09 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:10.001896 12285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:09.997354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:34371)
0809 23:20:09.997509 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:09.997520 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:09.997587 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:09.997703 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:09.997704 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:09.997881 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:09.997929 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:09.997930 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:09.998575 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:09.998576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:09.999049 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:09.999050 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:09.999336 (+ 286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:09.999336 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:09.999372 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:09.999773 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:09.999777 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:10.001767 (+ 1990us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":101,"threads_started":1}
W20260809 23:20:10.001945 12283 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:09.997417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:34371 (local address 127.1.235.190:40661)
0809 23:20:09.997473 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:09.997475 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:09.997575 (+ 100us) server_negotiation.cc:407] Connection header received
0809 23:20:09.997629 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:09.997630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:09.997642 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:09.997691 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:09.997989 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:09.998465 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:09.999117 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:09.999279 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:09.999325 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:10.001878 (+ 2553us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.131:34371: BlockingRecv error: recv got EOF from 127.1.235.131:34371 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 09 23:20:10 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:10 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:10.765633 12286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:10.760962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:39587)
0809 23:20:10.761131 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:10.761148 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:10.761230 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:10.761393 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:10.761394 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:10.761575 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:10.761627 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:10.761629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:10.762294 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:10.762295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:10.762803 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:10.762804 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:10.763114 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:10.763114 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:10.763157 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:10.763603 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:10.763607 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:10.765524 (+ 1917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":75,"threads_started":1}
W20260809 23:20:10.765733 12287 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:10.761037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:39587 (local address 127.1.235.190:40661)
0809 23:20:10.761202 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:10.761204 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:10.761213 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:20:10.761292 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:10.761293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:10.761304 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:10.761361 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:10.761707 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:10.762224 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:10.762873 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:10.763050 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:10.763105 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:10.765637 (+ 2532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:39587: BlockingRecv error: recv got EOF from 127.1.235.129:39587 (error 108)
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":79,"threads_started":1}
Aug 09 23:20:10 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:10 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:10.887787 12288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:10.882858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:55459)
0809 23:20:10.883051 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:10.883062 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:10.883138 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:10.883318 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:10.883320 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:10.883511 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:10.883562 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:10.883564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:10.884241 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:10.884242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:10.884732 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:10.884734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:10.885160 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:10.885162 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:10.885229 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:10.885694 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:10.885698 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:10.887726 (+ 2028us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":123,"threads_started":1}
W20260809 23:20:10.887989 12287 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:10.882971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:55459 (local address 127.1.235.190:40661)
0809 23:20:10.883026 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:10.883028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:10.883149 (+ 121us) server_negotiation.cc:407] Connection header received
0809 23:20:10.883227 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:10.883227 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:10.883241 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:10.883305 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:10.883646 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:10.884140 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:10.884826 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:10.885067 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:10.885160 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:10.887886 (+ 2726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:55459: BlockingRecv error: recv got EOF from 127.1.235.130:55459 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 09 23:20:11 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:11 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:11.006963 12290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:11.002402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:48619)
0809 23:20:11.002618 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:11.002630 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:11.002693 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:11.002835 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:11.002836 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:11.003016 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:11.003067 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:11.003069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:11.003657 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:11.003658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:11.004154 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:11.004156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:11.004456 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:11.004457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:11.004498 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:11.005004 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:11.005009 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:11.006905 (+ 1896us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":108,"threads_started":1}
W20260809 23:20:11.007135 12287 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:11.002491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:48619 (local address 127.1.235.190:40661)
0809 23:20:11.002553 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:11.002555 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:11.002690 (+ 135us) server_negotiation.cc:407] Connection header received
0809 23:20:11.002739 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:11.002739 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:11.002751 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:11.002798 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:11.003128 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:11.003569 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:11.004226 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:11.004392 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:11.004437 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:11.007041 (+ 2604us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.131:48619: BlockingRecv error: recv got EOF from 127.1.235.131:48619 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 09 23:20:11 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:11 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:11.770452 12291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:11.766192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:49161)
0809 23:20:11.766308 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:11.766321 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:11.766381 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:11.766545 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:11.766546 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:11.766711 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:11.766758 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:11.766759 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:11.767339 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:11.767339 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:11.767807 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:11.767808 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:11.768169 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:11.768170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:11.768209 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:11.768629 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:11.768633 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:11.770379 (+ 1746us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":52,"threads_started":1}
W20260809 23:20:11.770612 12292 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:11.766271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:49161 (local address 127.1.235.190:40661)
0809 23:20:11.766432 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:11.766434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:11.766441 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:20:11.766463 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:11.766464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:11.766473 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:11.766524 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:11.766815 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:11.767274 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:11.767905 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:11.768104 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:11.768155 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:11.770508 (+ 2353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:49161: BlockingRecv error: recv got EOF from 127.1.235.129:49161 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":87,"threads_started":1}
Aug 09 23:20:11 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:11 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:11.893164 12293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:11.888301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:52309)
0809 23:20:11.888470 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:11.888502 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:11.888580 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:11.888747 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:11.888748 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:11.888913 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:11.888960 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:11.888961 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:11.889585 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:11.889586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:11.890143 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:11.890145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:11.890526 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:11.890527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:11.890585 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:11.891125 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:11.891129 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:11.893098 (+ 1969us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":88,"threads_started":1}
W20260809 23:20:11.893297 12292 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:11.888372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:52309 (local address 127.1.235.190:40661)
0809 23:20:11.888459 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:11.888461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:11.888560 (+ 99us) server_negotiation.cc:407] Connection header received
0809 23:20:11.888674 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:11.888675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:11.888687 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:11.888732 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:11.889052 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:11.889494 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:11.890228 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:11.890449 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:11.890516 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:11.893204 (+ 2688us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:52309: BlockingRecv error: recv got EOF from 127.1.235.130:52309 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 09 23:20:12 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:12 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:12.012172 12294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:12.007394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:37523)
0809 23:20:12.007540 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:12.007552 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:12.007644 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:12.007813 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:12.007814 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:12.007991 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:12.008036 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:12.008038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:12.008745 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:12.008746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:12.009269 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:12.009270 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:12.009665 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:12.009666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:12.009724 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:12.010170 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:12.010174 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:12.012066 (+ 1892us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":70,"threads_started":1}
W20260809 23:20:12.012212 12292 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:12.007436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:37523 (local address 127.1.235.190:40661)
0809 23:20:12.007486 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:12.007488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:12.007645 (+ 157us) server_negotiation.cc:407] Connection header received
0809 23:20:12.007720 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:12.007721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:12.007732 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:12.007802 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:12.008154 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:12.008656 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:12.009361 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:12.009574 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:12.009663 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:12.012150 (+ 2487us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.131:37523: BlockingRecv error: recv got EOF from 127.1.235.131:37523 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 09 23:20:12 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:12 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:12.775636 12295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:12.771094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:56423)
0809 23:20:12.771245 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:12.771256 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:12.771306 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:12.771463 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:12.771463 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:12.771640 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:12.771707 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:12.771709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:12.772327 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:12.772328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:12.772839 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:12.772840 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:12.773142 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:12.773143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:12.773180 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:12.773602 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:12.773606 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:12.775562 (+ 1956us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":55,"threads_started":1}
W20260809 23:20:12.775758 12296 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:12.771228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:56423 (local address 127.1.235.190:40661)
0809 23:20:12.771347 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:12.771352 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:12.771360 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:20:12.771379 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:12.771379 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:12.771388 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:12.771445 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:12.771775 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:12.772265 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:12.772918 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:12.773085 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:12.773130 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:12.775653 (+ 2523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:56423: BlockingRecv error: recv got EOF from 127.1.235.129:56423 (error 108)
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":62,"threads_started":1}
Aug 09 23:20:12 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:12 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:12.898100 12297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:12.893651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:49187)
0809 23:20:12.893787 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:12.893796 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:12.893914 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:12.894061 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:12.894061 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:12.894219 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:12.894268 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:12.894269 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:12.895018 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:12.895018 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:12.895540 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:12.895541 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:12.895867 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:12.895868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:12.895906 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:12.896356 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:12.896359 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:12.898045 (+ 1686us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":79,"threads_started":1}
W20260809 23:20:12.898241 12296 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:12.893710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:49187 (local address 127.1.235.190:40661)
0809 23:20:12.893780 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:12.893782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:12.893958 (+ 176us) server_negotiation.cc:407] Connection header received
0809 23:20:12.893987 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:12.893987 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:12.894000 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:12.894041 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:12.894331 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:12.894956 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:12.895615 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:12.895803 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:12.895856 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:12.898154 (+ 2298us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:49187: BlockingRecv error: recv got EOF from 127.1.235.130:49187 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 09 23:20:13 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:13 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:13.017160 12298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:13.012715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:34073)
0809 23:20:13.012878 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:13.012888 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:13.012943 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:13.013079 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:13.013080 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:13.013292 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:13.013355 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:13.013357 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:13.014028 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:13.014029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:13.014560 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:13.014562 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:13.014888 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:13.014888 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:13.014924 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:13.015363 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:13.015368 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:13.017097 (+ 1729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":88,"threads_started":1}
W20260809 23:20:13.017249 12296 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:13.012756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:34073 (local address 127.1.235.190:40661)
0809 23:20:13.012835 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:13.012837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:13.012940 (+ 103us) server_negotiation.cc:407] Connection header received
0809 23:20:13.012984 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:13.012985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:13.012996 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:13.013042 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:13.013428 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:13.013964 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:13.014645 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:13.014828 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:13.014878 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:13.017186 (+ 2308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.131:34073: BlockingRecv error: recv got EOF from 127.1.235.131:34073 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 09 23:20:13 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:13 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:13.780643 12299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:13.776063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:33357)
0809 23:20:13.776222 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:13.776233 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:13.776284 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:13.776428 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:13.776429 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:13.776598 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:13.776646 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:13.776647 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:13.777267 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:13.777267 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:13.777775 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:13.777776 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:13.778278 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:13.778278 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:13.778325 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:13.778770 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:13.778774 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:13.780588 (+ 1814us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":87,"threads_started":1}
W20260809 23:20:13.780768 12300 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:13.776173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:33357 (local address 127.1.235.190:40661)
0809 23:20:13.776310 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:13.776312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:13.776320 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:20:13.776340 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:13.776341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:13.776352 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:13.776408 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:13.776727 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:13.777207 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:13.778037 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:13.778215 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:13.778265 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:13.780685 (+ 2420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:33357: BlockingRecv error: recv got EOF from 127.1.235.129:33357 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":76,"threads_started":1}
Aug 09 23:20:13 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:13 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:13.907765 12301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:13.898599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:36947)
0809 23:20:13.898742 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:13.898752 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:13.898804 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:13.898944 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:13.898945 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:13.899111 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:13.899180 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:13.899181 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:13.899820 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:13.899820 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:13.900330 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:13.900331 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:13.900687 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:13.900688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:13.900727 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:13.905988 (+ 5261us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:13.905993 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:13.907703 (+ 1710us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
W20260809 23:20:13.907859 12300 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:13.898696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:36947 (local address 127.1.235.190:40661)
0809 23:20:13.898748 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:13.898750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:13.898791 (+ 41us) server_negotiation.cc:407] Connection header received
0809 23:20:13.898859 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:13.898859 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:13.898870 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:13.898910 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:13.899253 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:13.899758 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:13.900397 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:13.900622 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:13.900668 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:13.907794 (+ 7126us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:36947: BlockingRecv error: recv got EOF from 127.1.235.130:36947 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 09 23:20:14 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:14 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:14.022509 12302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:14.017831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:45009)
0809 23:20:14.018023 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:14.018041 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:14.018098 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:14.018269 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:14.018269 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:14.018428 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:14.018476 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:14.018477 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:14.019087 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:14.019088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:14.019611 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:14.019613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:14.019968 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:14.019969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:14.020007 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:14.020474 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:14.020479 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:14.022452 (+ 1973us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":137,"threads_started":1}
W20260809 23:20:14.022607 12300 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:14.017957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:45009 (local address 127.1.235.190:40661)
0809 23:20:14.018030 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:14.018037 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:14.018149 (+ 112us) server_negotiation.cc:407] Connection header received
0809 23:20:14.018177 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:14.018177 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:14.018191 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:14.018249 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:14.018542 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:14.019022 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:14.019714 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:14.019896 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:14.019967 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:14.022540 (+ 2573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.131:45009: BlockingRecv error: recv got EOF from 127.1.235.131:45009 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 09 23:20:14 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:14 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:14.785992 12303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:14.781182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:43115)
0809 23:20:14.781348 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:14.781360 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:14.781420 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:14.781627 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:14.781628 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:14.781805 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:14.781919 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:14.781921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:14.782661 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:14.782661 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:14.783170 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:14.783172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:14.783585 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:14.783586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:14.783635 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:14.784089 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:14.784093 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:14.785924 (+ 1831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":108,"threads_started":1}
W20260809 23:20:14.786140 12304 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:14.781283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:43115 (local address 127.1.235.190:40661)
0809 23:20:14.781442 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:14.781445 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:14.781455 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:20:14.781487 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:14.781488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:14.781499 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:14.781580 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:14.782032 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:14.782564 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:14.783267 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:14.783514 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:14.783575 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:14.786040 (+ 2465us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:43115: BlockingRecv error: recv got EOF from 127.1.235.129:43115 (error 108)
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":100,"threads_started":1}
Aug 09 23:20:14 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:14 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:14.912540 12307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:14.908282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:55357)
0809 23:20:14.908448 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:14.908459 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:14.908516 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:14.908652 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:14.908652 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:14.908821 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:14.908872 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:14.908874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:14.909489 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:14.909490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:14.910023 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:14.910025 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:14.910332 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:14.910333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:14.910366 (+ 33us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:14.910802 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:14.910806 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:14.912483 (+ 1677us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":91,"threads_started":1}
W20260809 23:20:14.912662 12304 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:14.908365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:55357 (local address 127.1.235.190:40661)
0809 23:20:14.908432 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:14.908434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:14.908518 (+ 84us) server_negotiation.cc:407] Connection header received
0809 23:20:14.908571 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:14.908571 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:14.908582 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:14.908627 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:14.908933 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:14.909420 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:14.910095 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:14.910273 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:14.910321 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:14.912577 (+ 2256us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:55357: BlockingRecv error: recv got EOF from 127.1.235.130:55357 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 09 23:20:15 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:15 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:15.027451 12308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:15.022985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:53055)
0809 23:20:15.023139 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:15.023149 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:15.023196 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:15.023328 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:15.023329 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:15.023600 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:15.023667 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:15.023671 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:15.024343 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:15.024343 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:15.024825 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:15.024826 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:15.025120 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:15.025120 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:15.025157 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:15.025609 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:15.025613 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:15.027392 (+ 1779us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":97,"threads_started":1}
W20260809 23:20:15.027544 12304 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:15.023106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:53055 (local address 127.1.235.190:40661)
0809 23:20:15.023174 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:15.023176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:15.023184 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:20:15.023252 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:15.023253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:15.023263 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:15.023323 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:15.023770 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:15.024279 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:15.024890 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:15.025060 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:15.025107 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:15.027478 (+ 2371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.131:53055: BlockingRecv error: recv got EOF from 127.1.235.131:53055 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 23:20:15 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:15 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:15.791635 12309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:15.786524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:35315)
0809 23:20:15.786698 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:15.786708 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:15.786760 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:15.786869 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:15.786870 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:15.787040 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:15.787086 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:15.787087 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:15.787734 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:15.787736 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:15.788515 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:15.788518 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:15.788897 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:15.788897 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:15.788937 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:15.789470 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:15.789477 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:15.791511 (+ 2034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":96,"threads_started":1}
W20260809 23:20:15.791693 12310 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:15.786608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:35315 (local address 127.1.235.190:40661)
0809 23:20:15.786746 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:15.786748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:15.786757 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:20:15.786803 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:15.786804 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:15.786814 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:15.786865 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:15.787141 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:15.787624 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:15.788621 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:15.788810 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:15.788870 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:15.791603 (+ 2733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:35315: BlockingRecv error: recv got EOF from 127.1.235.129:35315 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":77,"threads_started":1}
Aug 09 23:20:15 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:15 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:15.917953 12311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:15.913053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:56579)
0809 23:20:15.913189 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:15.913201 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:15.913306 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:15.913449 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:15.913450 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:15.913635 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:15.913679 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:15.913681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:15.914352 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:15.914353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:15.914852 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:15.914854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:15.915189 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:15.915190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:15.915247 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:15.915830 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:15.915834 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:15.917869 (+ 2035us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":73,"threads_started":1}
W20260809 23:20:15.918006 12310 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:15.913156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:56579 (local address 127.1.235.190:40661)
0809 23:20:15.913224 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:15.913226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:15.913288 (+ 62us) server_negotiation.cc:407] Connection header received
0809 23:20:15.913361 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:15.913362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:15.913375 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:15.913445 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:15.913764 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:15.914270 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:15.914931 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:15.915118 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:15.915191 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:15.917944 (+ 2753us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:56579: BlockingRecv error: recv got EOF from 127.1.235.130:56579 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 09 23:20:16 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:16 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:16.032914 12312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:16.027994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:32927)
0809 23:20:16.028176 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:16.028185 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:16.028238 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:16.028380 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:16.028381 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:16.028556 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:16.028603 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:16.028605 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:16.029237 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:16.029238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:16.029776 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:16.029779 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:16.030204 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:16.030205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:16.030255 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:16.030827 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:16.030831 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:16.032843 (+ 2012us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":111,"threads_started":1}
W20260809 23:20:16.033054 12310 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:16.028080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:32927 (local address 127.1.235.190:40661)
0809 23:20:16.028178 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:16.028180 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:16.028258 (+ 78us) server_negotiation.cc:407] Connection header received
0809 23:20:16.028286 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:16.028287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:16.028300 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:16.028368 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:16.028662 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:16.029142 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:16.029954 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:16.030132 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:16.030184 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:16.032948 (+ 2764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.131:32927: BlockingRecv error: recv got EOF from 127.1.235.131:32927 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 09 23:20:16 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:16 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:16.796626 12313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:16.792117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:34433)
0809 23:20:16.792254 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:16.792280 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:16.792341 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:16.792506 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:16.792506 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:16.792684 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:16.792732 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:16.792734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:16.793376 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:16.793376 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:16.793950 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:16.793952 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:16.794329 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:16.794329 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:16.794369 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:16.794834 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:16.794838 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:16.796568 (+ 1730us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":164,"threads_started":1}
W20260809 23:20:16.796772 12314 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:16.792209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:34433 (local address 127.1.235.190:40661)
0809 23:20:16.792355 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:16.792357 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:16.792370 (+ 13us) server_negotiation.cc:407] Connection header received
0809 23:20:16.792411 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:16.792412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:16.792422 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:16.792483 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:16.792801 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:16.793303 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:16.794051 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:16.794256 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:16.794320 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:16.796682 (+ 2362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:34433: BlockingRecv error: recv got EOF from 127.1.235.129:34433 (error 108)
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":93,"threads_started":1}
Aug 09 23:20:16 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:16 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:16.924080 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:16.918472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:55195)
0809 23:20:16.918770 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:16.918785 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:16.918904 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:16.919109 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:16.919110 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:16.919320 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:16.919383 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:16.919386 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:16.920111 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:16.920112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:16.920739 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:16.920741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:16.921169 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:16.921170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:16.921261 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:16.921999 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:16.922004 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:16.923965 (+ 1961us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":98,"threads_started":1}
W20260809 23:20:16.924129 12314 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:16.918583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:55195 (local address 127.1.235.190:40661)
0809 23:20:16.918775 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:16.918777 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:16.918871 (+ 94us) server_negotiation.cc:407] Connection header received
0809 23:20:16.918993 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:16.918994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:16.919008 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:16.919085 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:16.919472 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:16.920019 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:16.920836 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:16.921067 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:16.921160 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:16.924058 (+ 2898us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:55195: BlockingRecv error: recv got EOF from 127.1.235.130:55195 (error 108)
Metrics: {"server-negotiator.queue_time_us":161}
Aug 09 23:20:17 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:17 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:17.038491 12316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:17.033416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:46231)
0809 23:20:17.033565 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:17.033576 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:17.033625 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:17.033764 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:17.033765 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:17.033965 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:17.034012 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:17.034013 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:17.034733 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:17.034735 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:17.035275 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:17.035276 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:17.035649 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:17.035650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:17.035691 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:17.036169 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:17.036175 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:17.038392 (+ 2217us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
W20260809 23:20:17.038542 12314 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:17.033532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:46231 (local address 127.1.235.190:40661)
0809 23:20:17.033607 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:17.033610 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:17.033620 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:20:17.033672 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:17.033672 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:17.033686 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:17.033746 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:17.034092 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:17.034604 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:17.035370 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:17.035573 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:17.035635 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:17.038479 (+ 2844us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.131:46231: BlockingRecv error: recv got EOF from 127.1.235.131:46231 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 23:20:17 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:17 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:17.801898 12318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:17.797205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:53261)
0809 23:20:17.797380 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:17.797425 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:17.797481 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:17.797666 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:17.797667 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:17.797904 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:17.797949 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:17.797952 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:17.798725 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:17.798726 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:17.799237 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:17.799239 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:17.799542 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:17.799543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:17.799581 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:17.800047 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:17.800051 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:17.801770 (+ 1719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":88,"threads_started":1}
W20260809 23:20:17.802006 12319 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:17.797276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:53261 (local address 127.1.235.190:40661)
0809 23:20:17.797433 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:17.797435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:17.797467 (+ 32us) server_negotiation.cc:407] Connection header received
0809 23:20:17.797552 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:17.797553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:17.797563 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:17.797614 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:17.798035 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:17.798625 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:17.799307 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:17.799481 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:17.799533 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:17.801916 (+ 2383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:53261: BlockingRecv error: recv got EOF from 127.1.235.129:53261 (error 108)
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":93,"threads_started":1}
Aug 09 23:20:17 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:17 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:17.929378 12320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:17.924586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:41751)
0809 23:20:17.924760 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:17.924771 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:17.924838 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:17.924987 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:17.924987 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:17.925162 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:17.925215 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:17.925217 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:17.925920 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:17.925921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:17.926733 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:17.926738 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:17.927106 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:17.927107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:17.927147 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:17.927583 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:17.927588 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:17.929311 (+ 1723us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":85,"threads_started":1}
W20260809 23:20:17.929507 12319 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:17.924712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:41751 (local address 127.1.235.190:40661)
0809 23:20:17.924771 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:17.924772 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:17.924832 (+ 60us) server_negotiation.cc:407] Connection header received
0809 23:20:17.924905 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:17.924906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:17.924915 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:17.924962 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:17.925274 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:17.925788 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:17.926843 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:17.927037 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:17.927095 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:17.929431 (+ 2336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:41751: BlockingRecv error: recv got EOF from 127.1.235.130:41751 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 09 23:20:18 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:18 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:18.046084 12321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:18.039074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:60709)
0809 23:20:18.039290 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:18.039306 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:18.039387 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:18.039603 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:18.039604 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:18.039852 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:18.039928 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:18.039931 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:18.040626 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:18.040627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:18.041536 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:18.041539 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:18.041955 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:18.041956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:18.042033 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:18.042534 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:18.042540 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:18.045957 (+ 3417us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":95,"threads_started":1}
W20260809 23:20:18.046106 12319 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:18.039276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:60709 (local address 127.1.235.190:40661)
0809 23:20:18.039469 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:18.039471 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:18.039478 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:20:18.039499 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:18.039499 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:18.039512 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:18.039557 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:18.040025 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:18.040546 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:18.041647 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:18.041827 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:18.041943 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:18.046056 (+ 4113us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.131:60709: BlockingRecv error: recv got EOF from 127.1.235.131:60709 (error 108)
Metrics: {"server-negotiator.queue_time_us":169}
Aug 09 23:20:18 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:18 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:18.807161 12322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:18.802477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:40557)
0809 23:20:18.802691 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:18.802700 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:18.802741 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:18.802978 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:18.802979 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:18.803169 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:18.803218 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:18.803220 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:18.803892 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:18.803893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:18.804421 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:18.804422 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:18.804776 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:18.804777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:18.804815 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:18.805263 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:18.805267 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:18.807102 (+ 1835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":59,"threads_started":1}
W20260809 23:20:18.807268 12323 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:18.802690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:40557 (local address 127.1.235.190:40661)
0809 23:20:18.802835 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:18.802836 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:18.802844 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:20:18.802869 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:18.802869 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:18.802880 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:18.802955 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:18.803302 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:18.803824 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:18.804499 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:18.804709 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:18.804764 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:18.807191 (+ 2427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:40557: BlockingRecv error: recv got EOF from 127.1.235.129:40557 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":77,"threads_started":1}
Aug 09 23:20:18 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:18 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:18.937532 12324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:18.929865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:58531)
0809 23:20:18.930037 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:18.930056 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:18.930113 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:18.930236 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:18.930237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:18.930407 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:18.930454 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:18.930456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:18.931072 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:18.931073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:18.931572 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:18.931574 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:18.931922 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:18.931922 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:18.931960 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:18.935404 (+ 3444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:18.935416 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:18.937463 (+ 2047us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":71,"threads_started":1}
W20260809 23:20:18.937678 12323 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:18.929983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:58531 (local address 127.1.235.190:40661)
0809 23:20:18.930060 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:18.930062 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:18.930097 (+ 35us) server_negotiation.cc:407] Connection header received
0809 23:20:18.930168 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:18.930169 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:18.930179 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:18.930216 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:18.930515 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:18.931000 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:18.931657 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:18.931855 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:18.931912 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:18.937612 (+ 5700us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:58531: BlockingRecv error: recv got EOF from 127.1.235.130:58531 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 09 23:20:19 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:19 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.131@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:19.050459 12325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:19.046503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.131:33859)
0809 23:20:19.046668 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:19.046678 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:19.046733 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:19.046892 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:19.046893 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:19.047063 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:19.047108 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:19.047109 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:19.047653 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:19.047654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:19.048099 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:19.048100 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:19.048370 (+ 270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:19.048371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:19.048404 (+ 33us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:19.048805 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:19.048810 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:19.050398 (+ 1588us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":101,"threads_started":1}
W20260809 23:20:19.050628 12323 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:19.046579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:33859 (local address 127.1.235.190:40661)
0809 23:20:19.046636 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:19.046637 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:19.046719 (+ 82us) server_negotiation.cc:407] Connection header received
0809 23:20:19.046799 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:19.046799 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:19.046812 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:19.046862 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:19.047167 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:19.047596 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:19.048162 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:19.048314 (+ 152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:19.048359 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:19.050507 (+ 2148us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.131:33859: BlockingRecv error: recv got EOF from 127.1.235.131:33859 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 09 23:20:19 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:19 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.129@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:19.812296 12326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:19.807726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.129:41523)
0809 23:20:19.807899 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:19.807909 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:19.807956 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:19.808075 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:19.808076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:19.808260 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:19.808309 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:19.808311 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:19.809012 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:19.809013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:19.809530 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:19.809532 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:19.809906 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:19.809907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:19.809967 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:19.810504 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:19.810508 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:19.812188 (+ 1680us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":108,"threads_started":1}
W20260809 23:20:19.812342 12327 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:19.807790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:41523 (local address 127.1.235.190:40661)
0809 23:20:19.807949 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:19.807951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:19.807959 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:20:19.807997 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:19.807998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:19.808008 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:19.808066 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:19.808404 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:19.808920 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:19.809615 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:19.809842 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:19.809900 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:19.812269 (+ 2369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.129:41523: BlockingRecv error: recv got EOF from 127.1.235.129:41523 (error 108)
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":86,"threads_started":1}
Aug 09 23:20:19 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
Aug 09 23:20:19 dist-test-slave-6nmv krb5kdc[11141](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.1.235.130@KRBTEST.COM for oryx/127.1.235.190@KRBTEST.COM, Server not found in Kerberos database
I20260809 23:20:19.942757 12328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:19.938063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40661 (local address 127.1.235.130:54479)
0809 23:20:19.938241 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:19.938252 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:19.938312 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:19.938442 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:19.938443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:19.938613 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:19.938673 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:19.938674 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:19.939308 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:19.939309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:19.939777 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:19.939779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:19.940131 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:19.940132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:19.940167 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:19.940691 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:19.940696 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:19.942657 (+ 1961us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.1.235.190:40661: Server oryx/127.1.235.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":130,"threads_started":1}
W20260809 23:20:19.942819 12327 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:19.938142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:54479 (local address 127.1.235.190:40661)
0809 23:20:19.938213 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:19.938215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:19.938303 (+ 88us) server_negotiation.cc:407] Connection header received
0809 23:20:19.938360 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:19.938361 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:19.938374 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:19.938430 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:19.938775 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:19.939241 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:19.939866 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:19.940063 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:19.940124 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:19.942745 (+ 2621us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.1.235.130:54479: BlockingRecv error: recv got EOF from 127.1.235.130:54479 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 23:20:19.969156 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 11799
I20260809 23:20:19.977981 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 11971
I20260809 23:20:19.983184 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 12118
I20260809 23:20:19.988344 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 11723
2026-08-09T23:20:19Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17502 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T23:20:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:20:20Z Disabled control of system clock
I20260809 23:20:20.019157 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:42921
--webserver_interface=127.1.235.190
--webserver_port=0
--builtin_ntp_servers=127.1.235.148:36231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:42921
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 23:20:20.099485 12332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:20.099690 12332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:20.099710 12332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:20.100875 12332 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:20:20.100916 12332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:20.100929 12332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:20.100941 12332 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:20:20.100986 12332 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:20:20.102353 12332 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:36231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:42921
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:42921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:20.102602 12332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:20.102907 12332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:20.107733 12337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:20.107744 12340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:20.107782 12332 server_base.cc:1034] running on GCE node
W20260809 23:20:20.107791 12338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:20.108275 12332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:20.108532 12332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:20.109762 12332 hybrid_clock.cc:648] HybridClock initialized: now 1786317620109747 us; error 29 us; skew 500 ppm
I20260809 23:20:20.111112 12332 webserver.cc:460] Webserver started at http://127.1.235.190:42741/ using document root <none> and password file <none>
I20260809 23:20:20.111356 12332 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:20.111409 12332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:20.111537 12332 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:20:20.112603 12332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "61d51707fe9744b49124cdbb0c43424b"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "c0f57305f5697f3df887a2697977b58b"
server_key_iv: "a40e09098684d77b8cadb185986b7c73"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.112968 12332 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "61d51707fe9744b49124cdbb0c43424b"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "c0f57305f5697f3df887a2697977b58b"
server_key_iv: "a40e09098684d77b8cadb185986b7c73"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.114365 12332 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:20:20.115125 12347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.115309 12332 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:20:20.115408 12332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "61d51707fe9744b49124cdbb0c43424b"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "c0f57305f5697f3df887a2697977b58b"
server_key_iv: "a40e09098684d77b8cadb185986b7c73"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.115490 12332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:20.133142 12332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:20.133430 12332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:20.133576 12332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:20.137607 12332 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:42921
I20260809 23:20:20.137641 12403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:42921 every 8 connection(s)
I20260809 23:20:20.137986 12332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:20:20.138672 12404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:20.141243 12404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b: Bootstrap starting.
I20260809 23:20:20.141800 12404 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:20.142166 12404 log.cc:824] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b: Log is configured to *not* fsync() on all Append() calls
I20260809 23:20:20.142817 12404 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b: No bootstrap required, opened a new log
I20260809 23:20:20.143603 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 12332
I20260809 23:20:20.143723 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:20:20.143916 1966 external_mini_cluster.cc:1428] Setting key eadf592fdf435517d2ad8843535d9fa1
I20260809 23:20:20.144796 12404 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61d51707fe9744b49124cdbb0c43424b" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 42921 } }
I20260809 23:20:20.144974 12404 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:20.145063 12404 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61d51707fe9744b49124cdbb0c43424b, State: Initialized, Role: FOLLOWER
I20260809 23:20:20.145228 12404 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61d51707fe9744b49124cdbb0c43424b" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 42921 } }
I20260809 23:20:20.145325 12404 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:20:20.145376 12404 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:20:20.145438 12404 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:20.146222 12404 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61d51707fe9744b49124cdbb0c43424b" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 42921 } }
I20260809 23:20:20.146335 12404 leader_election.cc:302] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61d51707fe9744b49124cdbb0c43424b; no voters:
I20260809 23:20:20.146521 12404 leader_election.cc:288] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:20:20.146553 12409 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:20:20.146737 12409 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [term 1 LEADER]: Becoming Leader. State: Replica: 61d51707fe9744b49124cdbb0c43424b, State: Running, Role: LEADER
I20260809 23:20:20.146768 12404 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:20:20.146873 12409 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61d51707fe9744b49124cdbb0c43424b" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 42921 } }
I20260809 23:20:20.147264 12411 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61d51707fe9744b49124cdbb0c43424b. Latest consensus state: current_term: 1 leader_uuid: "61d51707fe9744b49124cdbb0c43424b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61d51707fe9744b49124cdbb0c43424b" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 42921 } } }
I20260809 23:20:20.147414 12411 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [sys.catalog]: This master's current role is: LEADER
I20260809 23:20:20.147642 12417 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:20:20.148180 12417 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:20:20.148355 12410 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61d51707fe9744b49124cdbb0c43424b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61d51707fe9744b49124cdbb0c43424b" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 42921 } } }
I20260809 23:20:20.148558 12410 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b [sys.catalog]: This master's current role is: LEADER
I20260809 23:20:20.149904 12417 catalog_manager.cc:1347] Generated new cluster ID: a636e710544c4eb5aef51f84ead2f9dd
I20260809 23:20:20.149957 12417 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:20:20.151085 12408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:20.144435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33180 (local address 127.1.235.190:42921)
0809 23:20:20.144646 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:20.144652 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:20.144676 (+ 24us) server_negotiation.cc:407] Connection header received
0809 23:20:20.144763 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:20.144768 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:20.144827 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:20.144934 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:20.145253 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:20.147074 (+ 1821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:20.148645 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:20.149138 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:20.149239 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:20.150355 (+ 1116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:20.150359 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:20.150359 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:20:20.150585 (+ 226us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:20.150628 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:20:20.150644 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:20.150727 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:20.150791 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 23:20:20.150875 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":92,"threads_started":1}
I20260809 23:20:20.161847 12417 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:20:20.162498 12417 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:20:20.165733 12417 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61d51707fe9744b49124cdbb0c43424b: Generated new TSK 0
I20260809 23:20:20.165952 12417 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:20:20.169370 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:42921
--builtin_ntp_servers=127.1.235.148:36231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 23:20:20.245113 12428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:20.245292 12428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:20.245311 12428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:20.246523 12428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:20.246562 12428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:20.246585 12428 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:20:20.248027 12428 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:36231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:42921
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12428
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:20.248246 12428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:20.248533 12428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:20.253360 12433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:20.253355 12436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:20.253482 12434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:20.253760 12428 server_base.cc:1034] running on GCE node
I20260809 23:20:20.253980 12428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:20.254227 12428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:20.255375 12428 hybrid_clock.cc:648] HybridClock initialized: now 1786317620255353 us; error 40 us; skew 500 ppm
I20260809 23:20:20.256757 12428 webserver.cc:460] Webserver started at http://127.1.235.129:39089/ using document root <none> and password file <none>
I20260809 23:20:20.257038 12428 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:20.257083 12428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:20.257208 12428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:20:20.258261 12428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "7cdd3ec444694e008d5e7db69b50b831"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "8e69d1a3d57773df1eb9fbefcd0d36dc"
server_key_iv: "8797d4ea40a2e136b90b294d69181bd2"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.258590 12428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "7cdd3ec444694e008d5e7db69b50b831"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "8e69d1a3d57773df1eb9fbefcd0d36dc"
server_key_iv: "8797d4ea40a2e136b90b294d69181bd2"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.259856 12428 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:20.260600 12443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.260771 12428 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:20:20.260867 12428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "7cdd3ec444694e008d5e7db69b50b831"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "8e69d1a3d57773df1eb9fbefcd0d36dc"
server_key_iv: "8797d4ea40a2e136b90b294d69181bd2"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.260949 12428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:20.272140 12428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:20.272399 12428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:20.272541 12428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:20.272765 12428 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:20:20.273146 12428 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:20:20.273180 12428 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.273198 12428 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:20:20.273209 12428 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.279312 12428 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:45443
I20260809 23:20:20.279358 12570 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:45443 every 8 connection(s)
I20260809 23:20:20.279639 12428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:20:20.284256 12408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:20.280307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:47911 (local address 127.1.235.190:42921)
0809 23:20:20.280373 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:20.280376 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:20.280621 (+ 245us) server_negotiation.cc:407] Connection header received
0809 23:20:20.281039 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:20.281040 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:20.281052 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:20.281108 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:20.281719 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:20.282186 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:20.283044 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:20.283216 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:20.283270 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:20.283985 (+ 715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:20.283986 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:20.283986 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:20:20.283990 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:20.284005 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:20:20.284009 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:20.284058 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:20.284178 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 23:20:20.284201 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 23:20:20.284488 12574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:20.280286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:42921 (local address 127.1.235.129:47911)
0809 23:20:20.280510 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:20.280540 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:20.280958 (+ 418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:20.281216 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:20.281219 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:20.281226 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:20.281649 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:20.281652 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:20.282268 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:20.282268 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:20.282972 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:20.282974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:20.283291 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:20.283292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:20.283387 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:20.283845 (+ 458us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:20:20.283846 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:20.283872 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:20:20.283892 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:20:20.284097 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:20:20.284103 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:20:20.284106 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:20:20.284172 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 23:20:20.284247 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":119,"threads_started":1}
I20260809 23:20:20.284565 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 12428
I20260809 23:20:20.284654 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:20:20.284859 1966 external_mini_cluster.cc:1428] Setting key a443fb89ff5d59f53493d1c5e7271cf6
I20260809 23:20:20.285069 12571 heartbeater.cc:347] Connected to a master server at 127.1.235.190:42921
I20260809 23:20:20.285172 12571 heartbeater.cc:464] Registering TS with master...
I20260809 23:20:20.285377 12571 heartbeater.cc:511] Master 127.1.235.190:42921 requested a full tablet report, sending...
I20260809 23:20:20.285930 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:42921
--builtin_ntp_servers=127.1.235.148:36231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 23:20:20.285962 12365 ts_manager.cc:194] Registered new tserver with Master: 7cdd3ec444694e008d5e7db69b50b831 (127.1.235.129:45443)
I20260809 23:20:20.286584 12365 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.235.129:47911
W20260809 23:20:20.362142 12576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:20.362347 12576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:20.362382 12576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:20.363356 12576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:20.363437 12576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:20.363477 12576 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:20:20.364666 12576 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:36231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:42921
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12576
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:20.364912 12576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:20.365180 12576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:20.369992 12583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:20.370008 12585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:20.370007 12576 server_base.cc:1034] running on GCE node
W20260809 23:20:20.369984 12582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:20.370343 12576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:20.370600 12576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:20.371760 12576 hybrid_clock.cc:648] HybridClock initialized: now 1786317620371747 us; error 25 us; skew 500 ppm
I20260809 23:20:20.372912 12576 webserver.cc:460] Webserver started at http://127.1.235.130:43233/ using document root <none> and password file <none>
I20260809 23:20:20.373164 12576 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:20.373236 12576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:20.373399 12576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:20:20.374467 12576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "c5b747837a194ccbbc8b268dbf9b5861"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "48a21ce1cf1aa5bdfd009464ec0d8908"
server_key_iv: "914a1c7bb7c8261e134b375ab96d988d"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.374804 12576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "c5b747837a194ccbbc8b268dbf9b5861"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "48a21ce1cf1aa5bdfd009464ec0d8908"
server_key_iv: "914a1c7bb7c8261e134b375ab96d988d"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.376137 12576 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:20:20.376888 12592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.377094 12576 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:20.377194 12576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "c5b747837a194ccbbc8b268dbf9b5861"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "48a21ce1cf1aa5bdfd009464ec0d8908"
server_key_iv: "914a1c7bb7c8261e134b375ab96d988d"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.377278 12576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:20.388361 12576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:20.388636 12576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:20.388789 12576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:20.389014 12576 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:20:20.389353 12576 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:20:20.389415 12576 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.389456 12576 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:20:20.389487 12576 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.395569 12576 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:39553
I20260809 23:20:20.395635 12714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:39553 every 8 connection(s)
I20260809 23:20:20.395984 12576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:20:20.400981 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 12576
I20260809 23:20:20.401059 12408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:20.396817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:48331 (local address 127.1.235.190:42921)
0809 23:20:20.396933 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:20.396935 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:20.397114 (+ 179us) server_negotiation.cc:407] Connection header received
0809 23:20:20.397599 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:20.397601 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:20.397612 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:20.397664 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:20.398284 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:20.398769 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:20.399766 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:20.399964 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:20.400036 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:20.400778 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:20.400779 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:20.400780 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:20:20.400784 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:20.400798 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:20:20.400802 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:20.400864 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:20.400961 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 23:20:20.400987 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 23:20:20.401094 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:20:20.401257 12717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:20.396724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:42921 (local address 127.1.235.130:48331)
0809 23:20:20.396997 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:20.397035 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:20.397496 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:20.397721 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:20.397725 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:20.397733 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:20.398190 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:20.398194 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:20.398870 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:20.398871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:20.399681 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:20.399684 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:20.400045 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:20.400046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:20.400165 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:20.400641 (+ 476us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:20:20.400641 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:20.400665 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:20:20.400684 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:20:20.400866 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:20:20.400871 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:20:20.400874 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:20:20.400950 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 23:20:20.401038 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":92,"threads_started":1}
I20260809 23:20:20.401314 1966 external_mini_cluster.cc:1428] Setting key 628836cbe5308f97d72abe4ec627a322
I20260809 23:20:20.401701 12715 heartbeater.cc:347] Connected to a master server at 127.1.235.190:42921
I20260809 23:20:20.401784 12715 heartbeater.cc:464] Registering TS with master...
I20260809 23:20:20.401968 12715 heartbeater.cc:511] Master 127.1.235.190:42921 requested a full tablet report, sending...
I20260809 23:20:20.402338 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:42921
--builtin_ntp_servers=127.1.235.148:36231
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 23:20:20.402485 12365 ts_manager.cc:194] Registered new tserver with Master: c5b747837a194ccbbc8b268dbf9b5861 (127.1.235.130:39553)
I20260809 23:20:20.402848 12365 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.235.130:48331
W20260809 23:20:20.482983 12718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:20.483168 12718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:20.483188 12718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:20.484288 12718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:20.484328 12718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:20.484351 12718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:20:20.485605 12718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:36231
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:42921
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:20.485875 12718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:20.486172 12718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 23:20:20.490852 12718 server_base.cc:1034] running on GCE node
W20260809 23:20:20.490823 12724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:20.490825 12723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:20.490823 12726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:20.491340 12718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:20.491577 12718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:20.492759 12718 hybrid_clock.cc:648] HybridClock initialized: now 1786317620492741 us; error 51 us; skew 500 ppm
I20260809 23:20:20.494158 12718 webserver.cc:460] Webserver started at http://127.1.235.131:36713/ using document root <none> and password file <none>
I20260809 23:20:20.494406 12718 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:20.494452 12718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:20.494593 12718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:20:20.495595 12718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "2c506cdf53734e5fb28c88b1cca1d4f3"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "b71092f673d2423f7428b36aca053760"
server_key_iv: "defa38091cf33ca7992dbc9211f63f44"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.495971 12718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "2c506cdf53734e5fb28c88b1cca1d4f3"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "b71092f673d2423f7428b36aca053760"
server_key_iv: "defa38091cf33ca7992dbc9211f63f44"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.497287 12718 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:20:20.498193 12734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.498383 12718 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:20:20.498490 12718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "2c506cdf53734e5fb28c88b1cca1d4f3"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "b71092f673d2423f7428b36aca053760"
server_key_iv: "defa38091cf33ca7992dbc9211f63f44"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.498569 12718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:20.519644 12718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:20.519855 12718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:20.519945 12718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:20.520079 12718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:20:20.520375 12718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:20:20.520435 12718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.520471 12718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:20:20.520495 12718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.525753 12718 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:36571
I20260809 23:20:20.525847 12859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:36571 every 8 connection(s)
I20260809 23:20:20.526170 12718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:20:20.527595 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 12718
I20260809 23:20:20.527701 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:20:20.527913 1966 external_mini_cluster.cc:1428] Setting key 9d3ab8dc59f868155e029940e02f1d4a
I20260809 23:20:20.531529 12408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:20.526871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:53703 (local address 127.1.235.190:42921)
0809 23:20:20.526928 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:20.526930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:20.527225 (+ 295us) server_negotiation.cc:407] Connection header received
0809 23:20:20.527689 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:20.527690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:20.527703 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:20.527763 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:20.528788 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:20.529350 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:20.530290 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:20.530488 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:20.530562 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:20.531233 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:20.531234 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:20.531235 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:20:20.531239 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:20.531253 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:20:20.531257 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:20.531307 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:20.531423 (+ 116us) server_negotiation.cc:299] Negotiation successful
0809 23:20:20.531452 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 23:20:20.531757 12862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:20.526848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:42921 (local address 127.1.235.131:53703)
0809 23:20:20.527088 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:20.527116 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:20.527588 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:20.527840 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:20.527843 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:20.527851 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:20.528562 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:20.528570 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:20.529444 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:20.529445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:20.530195 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:20.530198 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:20.530573 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:20.530574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:20.530696 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:20.531098 (+ 402us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:20:20.531098 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:20.531121 (+ 23us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:20:20.531140 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:20:20.531313 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:20:20.531318 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:20:20.531320 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:20:20.531425 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 23:20:20.531515 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":139,"threads_started":1}
I20260809 23:20:20.532229 12860 heartbeater.cc:347] Connected to a master server at 127.1.235.190:42921
I20260809 23:20:20.532307 12860 heartbeater.cc:464] Registering TS with master...
I20260809 23:20:20.532517 12860 heartbeater.cc:511] Master 127.1.235.190:42921 requested a full tablet report, sending...
I20260809 23:20:20.532877 12365 ts_manager.cc:194] Registered new tserver with Master: 2c506cdf53734e5fb28c88b1cca1d4f3 (127.1.235.131:36571)
I20260809 23:20:20.533183 12365 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.235.131:53703
I20260809 23:20:20.539745 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 23:20:20.541503 12408 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:20.540952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33184 (local address 127.1.235.190:42921)
0809 23:20:20.541028 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:20.541030 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:20.541170 (+ 140us) server_negotiation.cc:407] Connection header received
0809 23:20:20.541220 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:20.541220 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:20.541229 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:20.541294 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:20.541449 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33184: BlockingRecv error: recv got EOF from 127.0.0.1:33184 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 23:20:20.541620 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 12428
I20260809 23:20:20.552425 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 12576
I20260809 23:20:20.559242 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 12718
I20260809 23:20:20.567219 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 12332
2026-08-09T23:20:20Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (577 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T23:20:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:20:20Z Disabled control of system clock
I20260809 23:20:20.595464 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:33641
--webserver_interface=127.1.235.190
--webserver_port=0
--builtin_ntp_servers=127.1.235.148:34285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:33641
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 23:20:20.675508 12871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:20.675701 12871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:20.675721 12871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:20.676775 12871 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:20:20.676810 12871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:20.676822 12871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:20.676836 12871 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:20:20.676846 12871 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:20:20.678094 12871 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:34285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:33641
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:33641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12871
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:20.678265 12871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:20.678483 12871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 23:20:20.682857 12871 server_base.cc:1034] running on GCE node
W20260809 23:20:20.682834 12881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:20.682821 12878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:20.682830 12879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:20.683211 12871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:20.683504 12871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:20.684674 12871 hybrid_clock.cc:648] HybridClock initialized: now 1786317620684669 us; error 29 us; skew 500 ppm
I20260809 23:20:20.685958 12871 webserver.cc:460] Webserver started at http://127.1.235.190:36997/ using document root <none> and password file <none>
I20260809 23:20:20.686199 12871 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:20.686269 12871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:20.686431 12871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:20:20.687481 12871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "7b05bb95fa3740a5b12a7bff64152dbe"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "4bf51a36a49744538d34c01e35cb1642"
server_key_iv: "0ad03b6f7135961581e19c54f3851dbf"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.687808 12871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "7b05bb95fa3740a5b12a7bff64152dbe"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "4bf51a36a49744538d34c01e35cb1642"
server_key_iv: "0ad03b6f7135961581e19c54f3851dbf"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.689039 12871 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:20:20.689656 12887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.689841 12871 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:20:20.689937 12871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "7b05bb95fa3740a5b12a7bff64152dbe"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "4bf51a36a49744538d34c01e35cb1642"
server_key_iv: "0ad03b6f7135961581e19c54f3851dbf"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.690011 12871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:20.693137 12871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:20.693408 12871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:20.693535 12871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:20.697291 12871 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:33641
I20260809 23:20:20.697340 12942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:33641 every 8 connection(s)
I20260809 23:20:20.697649 12871 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:20:20.698261 12943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:20.699137 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 12871
I20260809 23:20:20.699259 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:20:20.699440 1966 external_mini_cluster.cc:1428] Setting key 61df301c8ebd6e79a71eea341fe13c68
I20260809 23:20:20.701318 12943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe: Bootstrap starting.
I20260809 23:20:20.701684 12946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:20.699949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55208 (local address 127.1.235.190:33641)
0809 23:20:20.700124 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:20.700130 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:20.700153 (+ 23us) server_negotiation.cc:407] Connection header received
0809 23:20:20.700514 (+ 361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:20.700520 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:20.700565 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:20.700662 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:20.701277 (+ 615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:20.701280 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:20.701280 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:20:20.701283 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:20.701317 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:20:20.701326 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:20.701376 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:20.701460 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 23:20:20.701531 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":77,"threads_started":1}
I20260809 23:20:20.702026 12943 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:20.702281 12943 log.cc:824] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe: Log is configured to *not* fsync() on all Append() calls
I20260809 23:20:20.702956 12943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe: No bootstrap required, opened a new log
I20260809 23:20:20.704188 12943 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b05bb95fa3740a5b12a7bff64152dbe" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33641 } }
I20260809 23:20:20.704301 12943 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:20.704321 12943 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b05bb95fa3740a5b12a7bff64152dbe, State: Initialized, Role: FOLLOWER
I20260809 23:20:20.704401 12943 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b05bb95fa3740a5b12a7bff64152dbe" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33641 } }
I20260809 23:20:20.704455 12943 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:20:20.704474 12943 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:20:20.704504 12943 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:20.704912 12943 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b05bb95fa3740a5b12a7bff64152dbe" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33641 } }
I20260809 23:20:20.704989 12943 leader_election.cc:302] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b05bb95fa3740a5b12a7bff64152dbe; no voters:
I20260809 23:20:20.705091 12943 leader_election.cc:288] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:20:20.705385 12948 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:20:20.705389 12943 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:20:20.705556 12948 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [term 1 LEADER]: Becoming Leader. State: Replica: 7b05bb95fa3740a5b12a7bff64152dbe, State: Running, Role: LEADER
I20260809 23:20:20.705755 12948 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b05bb95fa3740a5b12a7bff64152dbe" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33641 } }
I20260809 23:20:20.706295 12950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b05bb95fa3740a5b12a7bff64152dbe. Latest consensus state: current_term: 1 leader_uuid: "7b05bb95fa3740a5b12a7bff64152dbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b05bb95fa3740a5b12a7bff64152dbe" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33641 } } }
I20260809 23:20:20.706414 12950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [sys.catalog]: This master's current role is: LEADER
I20260809 23:20:20.706430 12949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b05bb95fa3740a5b12a7bff64152dbe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b05bb95fa3740a5b12a7bff64152dbe" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33641 } } }
I20260809 23:20:20.706519 12949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe [sys.catalog]: This master's current role is: LEADER
I20260809 23:20:20.706947 12960 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:20:20.707407 12960 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:20:20.708830 12960 catalog_manager.cc:1347] Generated new cluster ID: a9037fc3f39447fc816179a6f2809c38
I20260809 23:20:20.708884 12960 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:20:20.720036 12960 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:20:20.720176 12960 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:20:20.726078 12960 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b05bb95fa3740a5b12a7bff64152dbe: Generated new TSK 0
I20260809 23:20:20.726238 12960 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:20:20.728323 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:33641
--builtin_ntp_servers=127.1.235.148:34285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 23:20:20.815097 12970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:20.815299 12970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:20.815332 12970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:20.816478 12970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:20.816541 12970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:20.816586 12970 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:20:20.817937 12970 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:34285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:33641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:20.818192 12970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:20.818462 12970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:20.824052 12975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:20.824046 12976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:20.824210 12978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:20.824345 12970 server_base.cc:1034] running on GCE node
I20260809 23:20:20.824556 12970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:20.824843 12970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:20.826031 12970 hybrid_clock.cc:648] HybridClock initialized: now 1786317620826011 us; error 36 us; skew 500 ppm
I20260809 23:20:20.827427 12970 webserver.cc:460] Webserver started at http://127.1.235.129:44873/ using document root <none> and password file <none>
I20260809 23:20:20.827677 12970 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:20.827739 12970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:20.827862 12970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:20:20.829099 12970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "436a63d0984743e8865f8b1a740cabc0"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "53d22f0a6974b14b23da12f0d2d2001b"
server_key_iv: "d7965b6cef6835680a1809df555302e9"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.829447 12970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "436a63d0984743e8865f8b1a740cabc0"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "53d22f0a6974b14b23da12f0d2d2001b"
server_key_iv: "d7965b6cef6835680a1809df555302e9"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.831067 12970 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:20:20.831851 12984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.832047 12970 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:20:20.832130 12970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "436a63d0984743e8865f8b1a740cabc0"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "53d22f0a6974b14b23da12f0d2d2001b"
server_key_iv: "d7965b6cef6835680a1809df555302e9"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.832193 12970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:20.836501 12970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:20.836752 12970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:20.836875 12970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:20.837087 12970 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:20:20.837369 12970 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:20:20.837417 12970 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.837445 12970 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:20:20.837477 12970 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.844410 12970 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:45465
I20260809 23:20:20.844458 13109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:45465 every 8 connection(s)
I20260809 23:20:20.844733 12970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:20:20.847684 12946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:20.845407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:39721 (local address 127.1.235.190:33641)
0809 23:20:20.845475 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:20.845477 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:20.845712 (+ 235us) server_negotiation.cc:407] Connection header received
0809 23:20:20.846235 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:20.846236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:20.846243 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:20.846319 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:20.847454 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:20.847455 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:20.847455 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:20:20.847459 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:20.847471 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:20:20.847475 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:20.847543 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:20.847590 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 23:20:20.847603 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 23:20:20.847823 13112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:20.845389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:33641 (local address 127.1.235.129:39721)
0809 23:20:20.845585 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:20.845621 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:20.846143 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:20.846373 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:20.846376 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:20.846384 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:20.847322 (+ 938us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:20:20.847323 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:20.847349 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:20:20.847376 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:20:20.847543 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:20:20.847545 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:20:20.847547 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:20:20.847588 (+ 41us) client_negotiation.cc:240] Negotiation successful
0809 23:20:20.847630 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":110,"threads_started":1}
I20260809 23:20:20.848301 13110 heartbeater.cc:347] Connected to a master server at 127.1.235.190:33641
I20260809 23:20:20.848400 13110 heartbeater.cc:464] Registering TS with master...
I20260809 23:20:20.848543 13110 heartbeater.cc:511] Master 127.1.235.190:33641 requested a full tablet report, sending...
I20260809 23:20:20.849022 12905 ts_manager.cc:194] Registered new tserver with Master: 436a63d0984743e8865f8b1a740cabc0 (127.1.235.129:45465)
I20260809 23:20:20.854218 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 12970
I20260809 23:20:20.854293 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:20:20.854436 1966 external_mini_cluster.cc:1428] Setting key 79f80520435e9b6109f038daf8f82a31
I20260809 23:20:20.855252 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:33641
--builtin_ntp_servers=127.1.235.148:34285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 23:20:20.933517 13113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:20.933706 13113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:20.933743 13113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:20.934861 13113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:20.934903 13113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:20.934935 13113 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:20:20.936281 13113 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:34285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:33641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13113
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:20.936455 13113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:20.936674 13113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:20.941331 13119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:20.941375 13121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:20.941336 13118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:20.941397 13113 server_base.cc:1034] running on GCE node
I20260809 23:20:20.941866 13113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:20.942104 13113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:20.943259 13113 hybrid_clock.cc:648] HybridClock initialized: now 1786317620943251 us; error 41 us; skew 500 ppm
I20260809 23:20:20.944391 13113 webserver.cc:460] Webserver started at http://127.1.235.130:45141/ using document root <none> and password file <none>
I20260809 23:20:20.944633 13113 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:20.944696 13113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:20.944829 13113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:20:20.945899 13113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "431a8437291048298ce94233de6840c8"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "ba396db173779f14c65b921fe2079135"
server_key_iv: "782732f915b112b8cf42cf7792d92b00"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.946278 13113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "431a8437291048298ce94233de6840c8"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "ba396db173779f14c65b921fe2079135"
server_key_iv: "782732f915b112b8cf42cf7792d92b00"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.947626 13113 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:20.948258 13127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.948432 13113 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.948522 13113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "431a8437291048298ce94233de6840c8"
format_stamp: "Formatted at 2026-08-09 23:20:20 on dist-test-slave-6nmv"
server_key: "ba396db173779f14c65b921fe2079135"
server_key_iv: "782732f915b112b8cf42cf7792d92b00"
server_key_version: "encryptionkey@0"
I20260809 23:20:20.948599 13113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:20.951838 13113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:20.952075 13113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:20.952186 13113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:20.952384 13113 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:20:20.952618 13113 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:20:20.952646 13113 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.952665 13113 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:20:20.952677 13113 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:20.957792 13113 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:39617
I20260809 23:20:20.957888 13254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:39617 every 8 connection(s)
I20260809 23:20:20.958168 13113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:20:20.960048 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 13113
I20260809 23:20:20.960162 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:20:20.960371 1966 external_mini_cluster.cc:1428] Setting key 9013479b595db53eec71b835c82dbb1f
I20260809 23:20:20.960933 12946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:20.958827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:57593 (local address 127.1.235.190:33641)
0809 23:20:20.958912 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:20.958915 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:20.959103 (+ 188us) server_negotiation.cc:407] Connection header received
0809 23:20:20.959461 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:20.959462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:20.959466 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:20.959513 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:20.960693 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:20.960695 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:20.960695 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:20:20.960699 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:20.960713 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:20:20.960730 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:20.960788 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:20.960841 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 23:20:20.960853 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 23:20:20.961092 13257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:20.958831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:33641 (local address 127.1.235.130:57593)
0809 23:20:20.959004 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:20.959031 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:20.959381 (+ 350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:20.959553 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:20.959556 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:20.959562 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:20.960512 (+ 950us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:20:20.960512 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:20.960546 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:20:20.960580 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:20:20.960788 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:20:20.960792 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:20:20.960793 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 23:20:20.960839 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 23:20:20.960880 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":101,"threads_started":1}
I20260809 23:20:20.961396 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:33641
--builtin_ntp_servers=127.1.235.148:34285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 23:20:20.962172 13255 heartbeater.cc:347] Connected to a master server at 127.1.235.190:33641
I20260809 23:20:20.962260 13255 heartbeater.cc:464] Registering TS with master...
I20260809 23:20:20.962410 13255 heartbeater.cc:511] Master 127.1.235.190:33641 requested a full tablet report, sending...
I20260809 23:20:20.962731 12905 ts_manager.cc:194] Registered new tserver with Master: 431a8437291048298ce94233de6840c8 (127.1.235.130:39617)
W20260809 23:20:21.036160 13258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:21.036346 13258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:21.036368 13258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:21.037596 13258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:21.037634 13258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:21.037659 13258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:20:21.038893 13258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:34285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:33641
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:21.039108 13258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:21.039409 13258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:21.044117 13264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:21.044093 13267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:21.044130 13265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:21.044184 13258 server_base.cc:1034] running on GCE node
I20260809 23:20:21.044420 13258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:21.044653 13258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:21.045939 13258 hybrid_clock.cc:648] HybridClock initialized: now 1786317621045927 us; error 38 us; skew 500 ppm
I20260809 23:20:21.047240 13258 webserver.cc:460] Webserver started at http://127.1.235.131:42671/ using document root <none> and password file <none>
I20260809 23:20:21.047478 13258 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:21.047550 13258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:21.047683 13258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:20:21.048707 13258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "1b7e6ec9202e4841be683e33eacfa397"
format_stamp: "Formatted at 2026-08-09 23:20:21 on dist-test-slave-6nmv"
server_key: "cd29ce23b9c3b70434bcd487db9a08ca"
server_key_iv: "d3ca8dcfb7c1517dc47155e1f97b6694"
server_key_version: "encryptionkey@0"
I20260809 23:20:21.049057 13258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "1b7e6ec9202e4841be683e33eacfa397"
format_stamp: "Formatted at 2026-08-09 23:20:21 on dist-test-slave-6nmv"
server_key: "cd29ce23b9c3b70434bcd487db9a08ca"
server_key_iv: "d3ca8dcfb7c1517dc47155e1f97b6694"
server_key_version: "encryptionkey@0"
I20260809 23:20:21.050453 13258 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 23:20:21.051221 13273 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:21.051359 13258 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:21.051433 13258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "1b7e6ec9202e4841be683e33eacfa397"
format_stamp: "Formatted at 2026-08-09 23:20:21 on dist-test-slave-6nmv"
server_key: "cd29ce23b9c3b70434bcd487db9a08ca"
server_key_iv: "d3ca8dcfb7c1517dc47155e1f97b6694"
server_key_version: "encryptionkey@0"
I20260809 23:20:21.051481 13258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:21.054526 13258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:21.054709 13258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:21.054790 13258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:21.054934 13258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:20:21.055209 13258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:20:21.055241 13258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:21.055289 13258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:20:21.055315 13258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:21.060957 13258 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:46563
I20260809 23:20:21.061021 13400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:46563 every 8 connection(s)
I20260809 23:20:21.061309 13258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:20:21.064276 12946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:21.061990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:37363 (local address 127.1.235.190:33641)
0809 23:20:21.062029 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:21.062031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:21.062249 (+ 218us) server_negotiation.cc:407] Connection header received
0809 23:20:21.062746 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:21.062747 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:21.062754 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:21.062817 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:21.064006 (+ 1189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:21.064008 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:21.064008 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:20:21.064013 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:21.064029 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:20:21.064033 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:21.064109 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:21.064190 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 23:20:21.064206 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 23:20:21.064487 13403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:21.061974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:33641 (local address 127.1.235.131:37363)
0809 23:20:21.062134 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:21.062163 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:21.062635 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:21.062883 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:21.062887 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:21.062896 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:21.063835 (+ 939us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:20:21.063835 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:21.063861 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:20:21.063887 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:20:21.064107 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:20:21.064114 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:20:21.064117 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:20:21.064200 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 23:20:21.064259 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":71,"threads_started":1}
I20260809 23:20:21.065004 13401 heartbeater.cc:347] Connected to a master server at 127.1.235.190:33641
I20260809 23:20:21.065096 13401 heartbeater.cc:464] Registering TS with master...
I20260809 23:20:21.065209 13401 heartbeater.cc:511] Master 127.1.235.190:33641 requested a full tablet report, sending...
I20260809 23:20:21.065541 12905 ts_manager.cc:194] Registered new tserver with Master: 1b7e6ec9202e4841be683e33eacfa397 (127.1.235.131:46563)
I20260809 23:20:21.066342 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 13258
I20260809 23:20:21.066433 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:20:21.066578 1966 external_mini_cluster.cc:1428] Setting key e703e40993e99d2e1e96feadf1b022e0
I20260809 23:20:21.067377 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 23:20:21.069278 12946 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:20:21.068735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55216 (local address 127.1.235.190:33641)
0809 23:20:21.068806 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:21.068808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:21.068933 (+ 125us) server_negotiation.cc:407] Connection header received
0809 23:20:21.069011 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:21.069012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:21.069017 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:21.069072 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:21.069204 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55216: BlockingRecv error: recv got EOF from 127.0.0.1:55216 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 23:20:21.069341 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 12970
I20260809 23:20:21.081950 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 13113
I20260809 23:20:21.088017 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 13258
I20260809 23:20:21.093783 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 12871
2026-08-09T23:20:21Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (526 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:20:21 dist-test-slave-6nmv krb5kdc[13411](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:20:21 dist-test-slave-6nmv krb5kdc[13411](info): set up 2 sockets
Aug 09 23:20:21 dist-test-slave-6nmv krb5kdc[13411](info): commencing operation
krb5kdc: starting...
W20260809 23:20:22.141539 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:20:22 dist-test-slave-6nmv krb5kdc[13411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:20:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:20:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:20:22.254761 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:38673
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:34049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:38673
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:20:22.330737 13424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:22.330941 13424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:22.330978 13424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:22.332051 13424 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:20:22.332115 13424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:22.332141 13424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:22.332175 13424 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:20:22.332203 13424 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:20:22.333585 13424 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:34049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:38673
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:38673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:22.333837 13424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:22.334033 13424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:22.338598 13430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:22.338572 13429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:22.338693 13424 server_base.cc:1034] running on GCE node
W20260809 23:20:22.338567 13433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:22.338974 13424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:22.339262 13424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:22.340407 13424 hybrid_clock.cc:648] HybridClock initialized: now 1786317622340395 us; error 27 us; skew 500 ppm
Aug 09 23:20:22 dist-test-slave-6nmv krb5kdc[13411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317622, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:20:22.342792 13424 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:20:22.343250 13424 webserver.cc:460] Webserver started at http://127.1.235.190:43333/ using document root <none> and password file <none>
I20260809 23:20:22.343462 13424 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:22.343526 13424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:22.343683 13424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:20:22.344623 13424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "c7f0c6db91bc40b7abfa09467926ddcb"
format_stamp: "Formatted at 2026-08-09 23:20:22 on dist-test-slave-6nmv"
server_key: "ea81c3b08ddc1fcd32282315b216e984"
server_key_iv: "a3420e9615aff87202bd24bf7426c9c2"
server_key_version: "encryptionkey@0"
I20260809 23:20:22.344959 13424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "c7f0c6db91bc40b7abfa09467926ddcb"
format_stamp: "Formatted at 2026-08-09 23:20:22 on dist-test-slave-6nmv"
server_key: "ea81c3b08ddc1fcd32282315b216e984"
server_key_iv: "a3420e9615aff87202bd24bf7426c9c2"
server_key_version: "encryptionkey@0"
I20260809 23:20:22.346314 13424 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:20:22.347067 13440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:22.347268 13424 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:22.347368 13424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "c7f0c6db91bc40b7abfa09467926ddcb"
format_stamp: "Formatted at 2026-08-09 23:20:22 on dist-test-slave-6nmv"
server_key: "ea81c3b08ddc1fcd32282315b216e984"
server_key_iv: "a3420e9615aff87202bd24bf7426c9c2"
server_key_version: "encryptionkey@0"
I20260809 23:20:22.347458 13424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:22.358278 13424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:22.359912 13424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:22.360055 13424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:22.363963 13424 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:38673
I20260809 23:20:22.363991 13495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:38673 every 8 connection(s)
I20260809 23:20:22.364283 13424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:20:22.365103 13496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:22.367170 13496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb: Bootstrap starting.
I20260809 23:20:22.367655 13496 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:22.367865 13496 log.cc:824] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb: Log is configured to *not* fsync() on all Append() calls
I20260809 23:20:22.368438 13496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb: No bootstrap required, opened a new log
I20260809 23:20:22.368803 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 13424
I20260809 23:20:22.368903 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:20:22.369122 1966 external_mini_cluster.cc:1428] Setting key c0abe99aa7f635e71802093f983cc3ae
I20260809 23:20:22.370572 13496 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7f0c6db91bc40b7abfa09467926ddcb" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38673 } }
I20260809 23:20:22.370716 13496 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:22.370751 13496 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7f0c6db91bc40b7abfa09467926ddcb, State: Initialized, Role: FOLLOWER
I20260809 23:20:22.370905 13496 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7f0c6db91bc40b7abfa09467926ddcb" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38673 } }
I20260809 23:20:22.370993 13496 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:20:22.371027 13496 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:20:22.371085 13496 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:22.372038 13496 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7f0c6db91bc40b7abfa09467926ddcb" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38673 } }
I20260809 23:20:22.372133 13496 leader_election.cc:302] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7f0c6db91bc40b7abfa09467926ddcb; no voters:
I20260809 23:20:22.372304 13496 leader_election.cc:288] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:20:22.372339 13501 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:20:22.372452 13501 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [term 1 LEADER]: Becoming Leader. State: Replica: c7f0c6db91bc40b7abfa09467926ddcb, State: Running, Role: LEADER
I20260809 23:20:22.372578 13496 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:20:22.372625 13501 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7f0c6db91bc40b7abfa09467926ddcb" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38673 } }
I20260809 23:20:22.373052 13502 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7f0c6db91bc40b7abfa09467926ddcb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7f0c6db91bc40b7abfa09467926ddcb" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38673 } } }
I20260809 23:20:22.373140 13502 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [sys.catalog]: This master's current role is: LEADER
I20260809 23:20:22.373365 13503 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7f0c6db91bc40b7abfa09467926ddcb. Latest consensus state: current_term: 1 leader_uuid: "c7f0c6db91bc40b7abfa09467926ddcb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7f0c6db91bc40b7abfa09467926ddcb" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38673 } } }
I20260809 23:20:22.373472 13503 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb [sys.catalog]: This master's current role is: LEADER
I20260809 23:20:22.373755 13508 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:20:22.374315 13508 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:20:22.375854 13508 catalog_manager.cc:1347] Generated new cluster ID: a3e203d50321494094e2eb00757ff294
I20260809 23:20:22.375903 13508 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 23:20:22 dist-test-slave-6nmv krb5kdc[13411](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:20:22.380082 13500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.369596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43834 (local address 127.1.235.190:38673)
0809 23:20:22.369790 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:22.369797 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:22.369875 (+ 78us) server_negotiation.cc:407] Connection header received
0809 23:20:22.370555 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:22.370560 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:22.370600 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:22.370698 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:22.371420 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.372378 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.373419 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.374118 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.374237 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.376702 (+ 2465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:22.376705 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:22.376706 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:20:22.376717 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:22.378489 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:22.378850 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:22.378853 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:22.378854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:22.378965 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:22.379196 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:22.379197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:22.379197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:22.379448 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:22.379606 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:22.379713 (+ 107us) server_negotiation.cc:299] Negotiation successful
0809 23:20:22.379941 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":99,"threads_started":1}
I20260809 23:20:22.382635 13508 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:20:22.383292 13508 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:20:22.390331 13508 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb: Generated new TSK 0
I20260809 23:20:22.390473 13508 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:20:22.418778 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:38673
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:34049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:20:22.499245 13524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:22.499459 13524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:22.499496 13524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:22.500568 13524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:22.500640 13524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:22.500697 13524 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:20:22.502070 13524 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:34049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:38673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:22.502311 13524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:22.502548 13524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:22.507141 13530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:22.507153 13532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:22.507210 13524 server_base.cc:1034] running on GCE node
W20260809 23:20:22.507164 13529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:22.507550 13524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:22.507820 13524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:22.508997 13524 hybrid_clock.cc:648] HybridClock initialized: now 1786317622508978 us; error 35 us; skew 500 ppm
Aug 09 23:20:22 dist-test-slave-6nmv krb5kdc[13411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317622, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:20:22.511264 13524 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:20:22.511672 13524 webserver.cc:460] Webserver started at http://127.1.235.129:34113/ using document root <none> and password file <none>
I20260809 23:20:22.511926 13524 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:22.512001 13524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:22.512151 13524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:20:22.513176 13524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "99923de29a64445296e6d26debeaec11"
format_stamp: "Formatted at 2026-08-09 23:20:22 on dist-test-slave-6nmv"
server_key: "5c071812f289e3d77fa78f4b4a2a1e8a"
server_key_iv: "1550ce4d42bb357617a5d9f3d57b41b7"
server_key_version: "encryptionkey@0"
I20260809 23:20:22.513523 13524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "99923de29a64445296e6d26debeaec11"
format_stamp: "Formatted at 2026-08-09 23:20:22 on dist-test-slave-6nmv"
server_key: "5c071812f289e3d77fa78f4b4a2a1e8a"
server_key_iv: "1550ce4d42bb357617a5d9f3d57b41b7"
server_key_version: "encryptionkey@0"
I20260809 23:20:22.514864 13524 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:20:22.515609 13539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:22.515784 13524 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:20:22.515877 13524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "99923de29a64445296e6d26debeaec11"
format_stamp: "Formatted at 2026-08-09 23:20:22 on dist-test-slave-6nmv"
server_key: "5c071812f289e3d77fa78f4b4a2a1e8a"
server_key_iv: "1550ce4d42bb357617a5d9f3d57b41b7"
server_key_version: "encryptionkey@0"
I20260809 23:20:22.515972 13524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:22.552084 13524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:22.554190 13524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:22.554354 13524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:22.554602 13524 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:20:22.554913 13524 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:20:22.554977 13524 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:22.555022 13524 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:20:22.555045 13524 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:22.560770 13524 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:43193
I20260809 23:20:22.560827 13659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:43193 every 8 connection(s)
I20260809 23:20:22.561133 13524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:20:22.563764 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 13524
I20260809 23:20:22.563875 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:20:22.564061 1966 external_mini_cluster.cc:1428] Setting key 762d3238d8a3c9fd558da561600034a0
Aug 09 23:20:22 dist-test-slave-6nmv krb5kdc[13411](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317622, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:20:22.571097 13500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.562054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:42829 (local address 127.1.235.190:38673)
0809 23:20:22.562128 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:22.562130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:22.562374 (+ 244us) server_negotiation.cc:407] Connection header received
0809 23:20:22.562814 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:22.562815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:22.562829 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:22.562896 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:22.563803 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.564478 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.565491 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.565700 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.565777 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.568047 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:22.568048 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:22.568049 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:20:22.568058 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:22.569575 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:22.570126 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:22.570127 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:22.570127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:22.570179 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:22.570489 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:22.570490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:22.570490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:22.570586 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:22.570647 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:22.570968 (+ 321us) server_negotiation.cc:299] Negotiation successful
0809 23:20:22.571036 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 23:20:22.571393 13662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.562029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38673 (local address 127.1.235.129:42829)
0809 23:20:22.562205 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:22.562248 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:22.562728 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:22.562939 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:22.562943 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:22.563499 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:22.563684 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:22.563689 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.564585 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.564586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:22.565381 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:22.565383 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.565786 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.565788 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:22.565958 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.566479 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:22.566486 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:22.567952 (+ 1466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:20:22.569658 (+ 1706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:22.569665 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:22.569668 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:22.570048 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:22.570256 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:22.570257 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:22.570257 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:22.570416 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:22.570663 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:20:22.570669 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:20:22.570836 (+ 167us) client_negotiation.cc:769] Sending connection context
0809 23:20:22.570953 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 23:20:22.571150 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":102,"threads_started":1}
I20260809 23:20:22.572028 13660 heartbeater.cc:347] Connected to a master server at 127.1.235.190:38673
I20260809 23:20:22.572124 13660 heartbeater.cc:464] Registering TS with master...
I20260809 23:20:22.572328 13660 heartbeater.cc:511] Master 127.1.235.190:38673 requested a full tablet report, sending...
I20260809 23:20:22.572929 13460 ts_manager.cc:194] Registered new tserver with Master: 99923de29a64445296e6d26debeaec11 (127.1.235.129:43193)
I20260809 23:20:22.573593 13460 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:42829
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:20:22.592530 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:38673
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:34049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:20:22.674844 13665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:22.675134 13665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:22.675187 13665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:22.676952 13665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:22.677016 13665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:22.677063 13665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:20:22.678886 13665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:34049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:38673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:22.679116 13665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:22.679299 13665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:22.684212 13672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:22.684257 13670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:22.684211 13674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:22.684383 13665 server_base.cc:1034] running on GCE node
I20260809 23:20:22.684600 13665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:22.684826 13665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:22.685983 13665 hybrid_clock.cc:648] HybridClock initialized: now 1786317622685975 us; error 25 us; skew 500 ppm
Aug 09 23:20:22 dist-test-slave-6nmv krb5kdc[13411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317622, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:20:22.688410 13665 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:20:22.688881 13665 webserver.cc:460] Webserver started at http://127.1.235.130:41449/ using document root <none> and password file <none>
I20260809 23:20:22.689110 13665 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:22.689177 13665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:22.689329 13665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:20:22.690496 13665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "dc9abbb5e8f24f5dbf503c53af59811a"
format_stamp: "Formatted at 2026-08-09 23:20:22 on dist-test-slave-6nmv"
server_key: "4e2ad8f36761cf507bd354c03f946f1e"
server_key_iv: "560a84f57cec916675cd0a24c1dfc392"
server_key_version: "encryptionkey@0"
I20260809 23:20:22.690893 13665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "dc9abbb5e8f24f5dbf503c53af59811a"
format_stamp: "Formatted at 2026-08-09 23:20:22 on dist-test-slave-6nmv"
server_key: "4e2ad8f36761cf507bd354c03f946f1e"
server_key_iv: "560a84f57cec916675cd0a24c1dfc392"
server_key_version: "encryptionkey@0"
I20260809 23:20:22.692399 13665 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:20:22.693219 13682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:22.693432 13665 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:20:22.693542 13665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "dc9abbb5e8f24f5dbf503c53af59811a"
format_stamp: "Formatted at 2026-08-09 23:20:22 on dist-test-slave-6nmv"
server_key: "4e2ad8f36761cf507bd354c03f946f1e"
server_key_iv: "560a84f57cec916675cd0a24c1dfc392"
server_key_version: "encryptionkey@0"
I20260809 23:20:22.693614 13665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:22.700773 13665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:22.702693 13665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:22.702843 13665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:22.703069 13665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:20:22.703354 13665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:20:22.703409 13665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:22.703441 13665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:20:22.703467 13665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:22.709414 13665 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:36425
I20260809 23:20:22.709470 13801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:36425 every 8 connection(s)
I20260809 23:20:22.709753 13665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:20:22.710754 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 13665
I20260809 23:20:22.710852 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:20:22.711124 1966 external_mini_cluster.cc:1428] Setting key 6400f2d94d4be57a51f97eea15be4534
Aug 09 23:20:22 dist-test-slave-6nmv krb5kdc[13411](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317622, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:20:22.720674 13500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.710544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:39093 (local address 127.1.235.190:38673)
0809 23:20:22.710615 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:22.710617 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:22.710821 (+ 204us) server_negotiation.cc:407] Connection header received
0809 23:20:22.711478 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:22.711479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:22.711492 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:22.711550 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:22.712512 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.713255 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.714705 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.715026 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.715122 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.717611 (+ 2489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:22.717612 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:22.717612 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:20:22.717619 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:22.719200 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:22.719708 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:22.719709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:22.719709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:22.719762 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:22.720041 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:22.720041 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:22.720042 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:22.720142 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:22.720190 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:22.720534 (+ 344us) server_negotiation.cc:299] Negotiation successful
0809 23:20:22.720611 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 23:20:22.720880 13804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.710523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38673 (local address 127.1.235.130:39093)
0809 23:20:22.710705 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:22.710739 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:22.711346 (+ 607us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:22.711602 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:22.711605 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:22.712240 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:22.712418 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:22.712422 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.713345 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.713346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:22.714622 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:22.714625 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.715131 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.715132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:22.715259 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.715783 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:22.715791 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:22.717513 (+ 1722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:20:22.719288 (+ 1775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:22.719294 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:22.719297 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:22.719617 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:22.719836 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:22.719837 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:22.719838 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:22.719966 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:22.720208 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:20:22.720214 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:20:22.720378 (+ 164us) client_negotiation.cc:769] Sending connection context
0809 23:20:22.720509 (+ 131us) client_negotiation.cc:240] Negotiation successful
0809 23:20:22.720675 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":101,"threads_started":1}
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
I20260809 23:20:22.721359 13802 heartbeater.cc:347] Connected to a master server at 127.1.235.190:38673
I20260809 23:20:22.721467 13802 heartbeater.cc:464] Registering TS with master...
I20260809 23:20:22.721638 13802 heartbeater.cc:511] Master 127.1.235.190:38673 requested a full tablet report, sending...
I20260809 23:20:22.722131 13460 ts_manager.cc:194] Registered new tserver with Master: dc9abbb5e8f24f5dbf503c53af59811a (127.1.235.130:36425)
I20260809 23:20:22.722491 13460 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:39093
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:20:22.738365 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:38673
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:34049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:20:22.814610 13807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:20:22.814802 13807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:20:22.814836 13807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:20:22.815897 13807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:20:22.815951 13807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:20:22.815996 13807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:20:22.817408 13807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:34049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:38673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:20:22.817633 13807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:20:22.817863 13807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:20:22.822506 13812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:22.822506 13813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:20:22.822535 13815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:20:22.822742 13807 server_base.cc:1034] running on GCE node
I20260809 23:20:22.822919 13807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:20:22.823153 13807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:20:22.824291 13807 hybrid_clock.cc:648] HybridClock initialized: now 1786317622824272 us; error 36 us; skew 500 ppm
Aug 09 23:20:22 dist-test-slave-6nmv krb5kdc[13411](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317622, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:20:22.826562 13807 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:20:22.826997 13807 webserver.cc:460] Webserver started at http://127.1.235.131:43783/ using document root <none> and password file <none>
I20260809 23:20:22.827221 13807 fs_manager.cc:359] Metadata directory not provided
I20260809 23:20:22.827289 13807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:20:22.827404 13807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:20:22.828275 13807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "5dd6302e07954febb0394f86d8a95c6f"
format_stamp: "Formatted at 2026-08-09 23:20:22 on dist-test-slave-6nmv"
server_key: "1a6db52eaee757a35e166c45f4e0dc58"
server_key_iv: "6af56243bec9dc3658c8937dd1648e33"
server_key_version: "encryptionkey@0"
I20260809 23:20:22.828603 13807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "5dd6302e07954febb0394f86d8a95c6f"
format_stamp: "Formatted at 2026-08-09 23:20:22 on dist-test-slave-6nmv"
server_key: "1a6db52eaee757a35e166c45f4e0dc58"
server_key_iv: "6af56243bec9dc3658c8937dd1648e33"
server_key_version: "encryptionkey@0"
I20260809 23:20:22.829864 13807 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:20:22.830556 13823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:22.830720 13807 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:20:22.830807 13807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "5dd6302e07954febb0394f86d8a95c6f"
format_stamp: "Formatted at 2026-08-09 23:20:22 on dist-test-slave-6nmv"
server_key: "1a6db52eaee757a35e166c45f4e0dc58"
server_key_iv: "6af56243bec9dc3658c8937dd1648e33"
server_key_version: "encryptionkey@0"
I20260809 23:20:22.830891 13807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:20:22.838088 13807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:20:22.839715 13807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:20:22.839848 13807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:20:22.840036 13807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:20:22.840317 13807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:20:22.840366 13807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:22.840401 13807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:20:22.840426 13807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:20:22.845793 13807 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:44723
I20260809 23:20:22.845930 13945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:44723 every 8 connection(s)
I20260809 23:20:22.846256 13807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
Aug 09 23:20:22 dist-test-slave-6nmv krb5kdc[13411](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317622, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:20:22.852526 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 13807
I20260809 23:20:22.852640 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:20:22.852831 1966 external_mini_cluster.cc:1428] Setting key 30479f0484cd7d89743c466fdecaf672
I20260809 23:20:22.854461 13500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.846922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:34497 (local address 127.1.235.190:38673)
0809 23:20:22.847013 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:22.847015 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:22.847128 (+ 113us) server_negotiation.cc:407] Connection header received
0809 23:20:22.847547 (+ 419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:22.847548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:22.847557 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:22.847612 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:22.848350 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.848790 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.849700 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.849927 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.849976 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.851892 (+ 1916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:22.851893 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:22.851893 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:20:22.851899 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:22.853339 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:22.853761 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:22.853761 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:22.853762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:22.853849 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:22.854052 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:22.854052 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:22.854053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:22.854143 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:22.854190 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:22.854352 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 23:20:22.854407 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 23:20:22.854615 13948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.846856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38673 (local address 127.1.235.131:34497)
0809 23:20:22.847015 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:22.847056 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:22.847458 (+ 402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:22.847655 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:22.847658 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:22.848127 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:20:22.848284 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:22.848288 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.848860 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.848860 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:22.849636 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:22.849638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.849999 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.850000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:22.850103 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.850524 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:20:22.850531 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:20:22.851813 (+ 1282us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:20:22.853402 (+ 1589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:22.853408 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:22.853410 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:22.853693 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:22.853901 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:20:22.853901 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:20:22.853902 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:20:22.854003 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:20:22.854180 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:20:22.854182 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:20:22.854266 (+ 84us) client_negotiation.cc:769] Sending connection context
0809 23:20:22.854329 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 23:20:22.854430 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260809 23:20:22.855082 13946 heartbeater.cc:347] Connected to a master server at 127.1.235.190:38673
I20260809 23:20:22.855149 13946 heartbeater.cc:464] Registering TS with master...
I20260809 23:20:22.855315 13946 heartbeater.cc:511] Master 127.1.235.190:38673 requested a full tablet report, sending...
I20260809 23:20:22.855659 13460 ts_manager.cc:194] Registered new tserver with Master: 5dd6302e07954febb0394f86d8a95c6f (127.1.235.131:44723)
I20260809 23:20:22.855996 13460 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:34497
I20260809 23:20:22.864766 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:20:22.872205 13500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.866199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43838 (local address 127.1.235.190:38673)
0809 23:20:22.866284 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:22.866286 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:22.866403 (+ 117us) server_negotiation.cc:407] Connection header received
0809 23:20:22.866489 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:22.866490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:22.866501 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:22.866579 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:20:22.867216 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.867665 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.868498 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.868673 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.868761 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.869880 (+ 1119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:20:22.869882 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:20:22.869882 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:20:22.869889 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:20:22.871004 (+ 1115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:22.871343 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:22.871344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:22.871344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:22.871400 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:20:22.871637 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:20:22.871638 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:20:22.871638 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:20:22.871809 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:20:22.871921 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:22.872032 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 23:20:22.872111 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 23:20:22.873759 13460 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43838:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:20:22.875451 13460 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:20:22.881708 13954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.877476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:36425 (local address 127.0.0.1:52516)
0809 23:20:22.877621 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:22.877654 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:22.877714 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:22.878174 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:22.878177 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:22.878179 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:20:22.878241 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:22.878243 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.879527 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.879528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:22.880564 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:22.880566 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.881412 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.881413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:22.881503 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.881517 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 23:20:22.881587 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 23:20:22.881638 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":53,"threads_started":1}
I20260809 23:20:22.881754 13957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.877585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52516 (local address 127.1.235.130:36425)
0809 23:20:22.877982 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:22.877987 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:22.877998 (+ 11us) server_negotiation.cc:407] Connection header received
0809 23:20:22.878039 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:22.878041 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:22.878057 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:22.878167 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:20:22.878325 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.879416 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.880719 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.881342 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.881410 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.881463 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:22.881618 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 23:20:22.881667 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":101,"threads_started":1}
I20260809 23:20:22.881944 13959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.877476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:43193 (local address 127.0.0.1:54880)
0809 23:20:22.877774 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:22.877784 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:22.877856 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:22.878315 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:22.878316 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:22.878319 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:20:22.878365 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:22.878367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.879239 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.879240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:22.880504 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:22.880507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.881507 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.881508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:22.881590 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.881595 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 23:20:22.881646 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 23:20:22.881687 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"mutex_wait_us":30,"spinlock_wait_cycles":768,"thread_start_us":62,"threads_started":1}
I20260809 23:20:22.882194 13961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.877792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54880 (local address 127.1.235.129:43193)
0809 23:20:22.877999 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:22.878003 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:22.878013 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:20:22.878048 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:22.878050 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:22.878064 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:22.878441 (+ 377us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:20:22.878517 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.879141 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.880592 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.881328 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.881405 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.881463 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:22.881756 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 23:20:22.882068 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":127,"threads_started":1}
I20260809 23:20:22.882613 13731 tablet_service.cc:1467] Processing CreateTablet for tablet b6554a74516b431bbae0422a142c65e5 (DEFAULT_TABLE table=test-table [id=c47e651156bd4557a954632173c02ef1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:20:22.882804 13956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.877680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:44723 (local address 127.0.0.1:37240)
0809 23:20:22.878002 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:22.878018 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:22.878088 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:22.878299 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:22.878299 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:22.878301 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:20:22.878336 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:22.878337 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.880642 (+ 2305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.880643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:22.881276 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:22.881278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.882576 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.882577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:22.882639 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.882643 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:20:22.882699 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 23:20:22.882740 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":40,"threads_started":1}
I20260809 23:20:22.882825 13960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.877759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37240 (local address 127.1.235.131:44723)
0809 23:20:22.877927 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:22.877932 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:22.878088 (+ 156us) server_negotiation.cc:407] Connection header received
0809 23:20:22.878152 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:22.878154 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:22.878169 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:22.878240 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:20:22.878410 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.879423 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.881367 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.882479 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.882572 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.882626 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:22.882716 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 23:20:22.882754 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":93,"threads_started":1}
I20260809 23:20:22.883034 13731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6554a74516b431bbae0422a142c65e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:22.885792 13962 tablet_bootstrap.cc:492] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a: Bootstrap starting.
I20260809 23:20:22.886389 13591 tablet_service.cc:1467] Processing CreateTablet for tablet b6554a74516b431bbae0422a142c65e5 (DEFAULT_TABLE table=test-table [id=c47e651156bd4557a954632173c02ef1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:20:22.886524 13962 tablet_bootstrap.cc:654] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:22.886719 13591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6554a74516b431bbae0422a142c65e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:22.886656 13875 tablet_service.cc:1467] Processing CreateTablet for tablet b6554a74516b431bbae0422a142c65e5 (DEFAULT_TABLE table=test-table [id=c47e651156bd4557a954632173c02ef1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:20:22.886940 13875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b6554a74516b431bbae0422a142c65e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:20:22.887121 13962 log.cc:824] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a: Log is configured to *not* fsync() on all Append() calls
I20260809 23:20:22.887835 13962 tablet_bootstrap.cc:492] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a: No bootstrap required, opened a new log
I20260809 23:20:22.887923 13962 ts_tablet_manager.cc:1397] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260809 23:20:22.889528 13962 raft_consensus.cc:348] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99923de29a64445296e6d26debeaec11" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43193 } } peers { permanent_uuid: "5dd6302e07954febb0394f86d8a95c6f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44723 } } peers { permanent_uuid: "dc9abbb5e8f24f5dbf503c53af59811a" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36425 } }
I20260809 23:20:22.889671 13962 raft_consensus.cc:374] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:22.889714 13962 raft_consensus.cc:729] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc9abbb5e8f24f5dbf503c53af59811a, State: Initialized, Role: FOLLOWER
I20260809 23:20:22.889881 13962 consensus_queue.cc:260] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99923de29a64445296e6d26debeaec11" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43193 } } peers { permanent_uuid: "5dd6302e07954febb0394f86d8a95c6f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44723 } } peers { permanent_uuid: "dc9abbb5e8f24f5dbf503c53af59811a" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36425 } }
I20260809 23:20:22.890187 13962 ts_tablet_manager.cc:1428] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:20:22.890219 13802 heartbeater.cc:503] Master 127.1.235.190:38673 was elected leader, sending a full tablet report...
I20260809 23:20:22.890338 13965 tablet_bootstrap.cc:492] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11: Bootstrap starting.
I20260809 23:20:22.891019 13965 tablet_bootstrap.cc:654] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:22.891603 13965 log.cc:824] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11: Log is configured to *not* fsync() on all Append() calls
I20260809 23:20:22.890192 13966 tablet_bootstrap.cc:492] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f: Bootstrap starting.
I20260809 23:20:22.892334 13965 tablet_bootstrap.cc:492] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11: No bootstrap required, opened a new log
I20260809 23:20:22.892350 13966 tablet_bootstrap.cc:654] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f: Neither blocks nor log segments found. Creating new log.
I20260809 23:20:22.892390 13965 ts_tablet_manager.cc:1397] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:20:22.892841 13966 log.cc:824] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f: Log is configured to *not* fsync() on all Append() calls
I20260809 23:20:22.893666 13966 tablet_bootstrap.cc:492] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f: No bootstrap required, opened a new log
I20260809 23:20:22.893718 13966 ts_tablet_manager.cc:1397] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260809 23:20:22.894022 13965 raft_consensus.cc:348] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99923de29a64445296e6d26debeaec11" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43193 } } peers { permanent_uuid: "5dd6302e07954febb0394f86d8a95c6f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44723 } } peers { permanent_uuid: "dc9abbb5e8f24f5dbf503c53af59811a" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36425 } }
I20260809 23:20:22.894160 13965 raft_consensus.cc:374] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:22.894205 13965 raft_consensus.cc:729] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99923de29a64445296e6d26debeaec11, State: Initialized, Role: FOLLOWER
I20260809 23:20:22.894310 13965 consensus_queue.cc:260] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99923de29a64445296e6d26debeaec11" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43193 } } peers { permanent_uuid: "5dd6302e07954febb0394f86d8a95c6f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44723 } } peers { permanent_uuid: "dc9abbb5e8f24f5dbf503c53af59811a" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36425 } }
I20260809 23:20:22.894565 13965 ts_tablet_manager.cc:1428] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:20:22.894636 13660 heartbeater.cc:503] Master 127.1.235.190:38673 was elected leader, sending a full tablet report...
I20260809 23:20:22.895330 13966 raft_consensus.cc:348] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99923de29a64445296e6d26debeaec11" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43193 } } peers { permanent_uuid: "5dd6302e07954febb0394f86d8a95c6f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44723 } } peers { permanent_uuid: "dc9abbb5e8f24f5dbf503c53af59811a" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36425 } }
I20260809 23:20:22.895509 13966 raft_consensus.cc:374] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:20:22.895555 13966 raft_consensus.cc:729] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dd6302e07954febb0394f86d8a95c6f, State: Initialized, Role: FOLLOWER
I20260809 23:20:22.895639 13966 consensus_queue.cc:260] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99923de29a64445296e6d26debeaec11" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43193 } } peers { permanent_uuid: "5dd6302e07954febb0394f86d8a95c6f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44723 } } peers { permanent_uuid: "dc9abbb5e8f24f5dbf503c53af59811a" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36425 } }
I20260809 23:20:22.895828 13966 ts_tablet_manager.cc:1428] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:20:22.895884 13946 heartbeater.cc:503] Master 127.1.235.190:38673 was elected leader, sending a full tablet report...
I20260809 23:20:22.947176 13972 raft_consensus.cc:482] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:20:22.947299 13972 raft_consensus.cc:504] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99923de29a64445296e6d26debeaec11" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43193 } } peers { permanent_uuid: "5dd6302e07954febb0394f86d8a95c6f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44723 } } peers { permanent_uuid: "dc9abbb5e8f24f5dbf503c53af59811a" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36425 } }
I20260809 23:20:22.947757 13972 leader_election.cc:288] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99923de29a64445296e6d26debeaec11 (127.1.235.129:43193), dc9abbb5e8f24f5dbf503c53af59811a (127.1.235.130:36425)
I20260809 23:20:22.951393 13961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.948024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:59447 (local address 127.1.235.129:43193)
0809 23:20:22.948073 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:22.948075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:22.948086 (+ 11us) server_negotiation.cc:407] Connection header received
0809 23:20:22.948127 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:22.948127 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:22.948137 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:22.948205 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:20:22.948385 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.949152 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.950501 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.951049 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.951126 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.951134 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:22.951289 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 23:20:22.951325 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 23:20:22.951393 13957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.948011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:35569 (local address 127.1.235.130:36425)
0809 23:20:22.948055 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:22.948057 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:22.948301 (+ 244us) server_negotiation.cc:407] Connection header received
0809 23:20:22.948340 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:22.948341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:22.948365 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:22.948415 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:20:22.948539 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.949231 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.950500 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.951049 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.951126 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.951134 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:22.951289 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 23:20:22.951329 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 23:20:22.951402 13948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.947921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:43193 (local address 127.1.235.131:59447)
0809 23:20:22.947971 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:22.947982 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:22.948026 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:22.948223 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:22.948224 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:22.948227 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:20:22.948315 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:22.948317 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.949224 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.949225 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:22.950410 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:22.950413 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.951132 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.951133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:22.951216 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.951218 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:20:22.951271 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 23:20:22.951314 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":19}
I20260809 23:20:22.951411 13973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.947924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:36425 (local address 127.1.235.131:35569)
0809 23:20:22.948209 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:22.948219 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:20:22.948290 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:20:22.948427 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:20:22.948427 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:20:22.948429 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:20:22.948477 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:22.948478 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.949298 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.949299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:22.950411 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:20:22.950413 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.951132 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.951133 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:20:22.951211 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.951215 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:20:22.951271 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 23:20:22.951314 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":59,"thread_start_us":145,"threads_started":1}
I20260809 23:20:22.951841 13754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6554a74516b431bbae0422a142c65e5" candidate_uuid: "5dd6302e07954febb0394f86d8a95c6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc9abbb5e8f24f5dbf503c53af59811a" is_pre_election: true
I20260809 23:20:22.951877 13612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6554a74516b431bbae0422a142c65e5" candidate_uuid: "5dd6302e07954febb0394f86d8a95c6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99923de29a64445296e6d26debeaec11" is_pre_election: true
I20260809 23:20:22.951978 13754 raft_consensus.cc:2454] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd6302e07954febb0394f86d8a95c6f in term 0.
I20260809 23:20:22.952060 13612 raft_consensus.cc:2454] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dd6302e07954febb0394f86d8a95c6f in term 0.
I20260809 23:20:22.952255 13827 leader_election.cc:302] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd6302e07954febb0394f86d8a95c6f, dc9abbb5e8f24f5dbf503c53af59811a; no voters:
I20260809 23:20:22.952425 13972 raft_consensus.cc:2781] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:20:22.952503 13972 raft_consensus.cc:482] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:20:22.952536 13972 raft_consensus.cc:3037] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:22.953271 13972 raft_consensus.cc:504] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99923de29a64445296e6d26debeaec11" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43193 } } peers { permanent_uuid: "5dd6302e07954febb0394f86d8a95c6f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44723 } } peers { permanent_uuid: "dc9abbb5e8f24f5dbf503c53af59811a" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36425 } }
I20260809 23:20:22.953423 13972 leader_election.cc:288] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [CANDIDATE]: Term 1 election: Requested vote from peers 99923de29a64445296e6d26debeaec11 (127.1.235.129:43193), dc9abbb5e8f24f5dbf503c53af59811a (127.1.235.130:36425)
I20260809 23:20:22.953585 13612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6554a74516b431bbae0422a142c65e5" candidate_uuid: "5dd6302e07954febb0394f86d8a95c6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99923de29a64445296e6d26debeaec11"
I20260809 23:20:22.953581 13754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b6554a74516b431bbae0422a142c65e5" candidate_uuid: "5dd6302e07954febb0394f86d8a95c6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc9abbb5e8f24f5dbf503c53af59811a"
I20260809 23:20:22.953662 13612 raft_consensus.cc:3037] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:22.953665 13754 raft_consensus.cc:3037] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:20:22.954540 13612 raft_consensus.cc:2454] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd6302e07954febb0394f86d8a95c6f in term 1.
I20260809 23:20:22.954540 13754 raft_consensus.cc:2454] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dd6302e07954febb0394f86d8a95c6f in term 1.
I20260809 23:20:22.954698 13827 leader_election.cc:302] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dd6302e07954febb0394f86d8a95c6f, dc9abbb5e8f24f5dbf503c53af59811a; no voters:
I20260809 23:20:22.954787 13972 raft_consensus.cc:2781] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:20:22.954911 13972 raft_consensus.cc:686] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [term 1 LEADER]: Becoming Leader. State: Replica: 5dd6302e07954febb0394f86d8a95c6f, State: Running, Role: LEADER
I20260809 23:20:22.955001 13972 consensus_queue.cc:237] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99923de29a64445296e6d26debeaec11" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43193 } } peers { permanent_uuid: "5dd6302e07954febb0394f86d8a95c6f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44723 } } peers { permanent_uuid: "dc9abbb5e8f24f5dbf503c53af59811a" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36425 } }
I20260809 23:20:22.955785 13460 catalog_manager.cc:5495] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5dd6302e07954febb0394f86d8a95c6f (127.1.235.131). New cstate: current_term: 1 leader_uuid: "5dd6302e07954febb0394f86d8a95c6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99923de29a64445296e6d26debeaec11" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43193 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dd6302e07954febb0394f86d8a95c6f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc9abbb5e8f24f5dbf503c53af59811a" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36425 } health_report { overall_health: UNKNOWN } } }
W20260809 23:20:22.960330 13803 tablet.cc:2369] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:20:22.972268 13960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.969717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37250 (local address 127.1.235.131:44723)
0809 23:20:22.969763 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 23:20:22.969765 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:20:22.969774 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:20:22.969850 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:20:22.969851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:20:22.969879 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:20:22.969975 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:20:22.970132 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.970580 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.971374 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:20:22.971560 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:20:22.971653 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:20:22.971870 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:20:22.971958 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:20:22.972067 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 23:20:22.972138 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 23:20:22.972159 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 23:20:22.974021 13612 raft_consensus.cc:1261] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11 [term 1 FOLLOWER]: Refusing update from remote peer 5dd6302e07954febb0394f86d8a95c6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:20:22.974040 13754 raft_consensus.cc:1261] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a [term 1 FOLLOWER]: Refusing update from remote peer 5dd6302e07954febb0394f86d8a95c6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:20:22.974331 13974 consensus_queue.cc:1035] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "99923de29a64445296e6d26debeaec11" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43193 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:20:22.974466 13972 consensus_queue.cc:1035] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc9abbb5e8f24f5dbf503c53af59811a" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 36425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:20:22.977186 13978 mvcc.cc:205] Tried to move back new op lower bound from 7316756983699058688 to 7316756983624413184. Current Snapshot: MvccSnapshot[applied={T|T < 7316756983699058688}]
I20260809 23:20:22.977316 13977 mvcc.cc:205] Tried to move back new op lower bound from 7316756983699058688 to 7316756983624413184. Current Snapshot: MvccSnapshot[applied={T|T < 7316756983699058688 or (T in {7316756983699058688})}]
I20260809 23:20:22.978888 13458 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:20:22.978976 13458 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:20:22.979763 13458 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c7f0c6db91bc40b7abfa09467926ddcb: Sending DeleteTablet for 3 replicas of tablet b6554a74516b431bbae0422a142c65e5
I20260809 23:20:22.980075 13875 tablet_service.cc:1514] Processing DeleteTablet for tablet b6554a74516b431bbae0422a142c65e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:20:22 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:37240
I20260809 23:20:22.980082 13591 tablet_service.cc:1514] Processing DeleteTablet for tablet b6554a74516b431bbae0422a142c65e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:20:22 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:54880
I20260809 23:20:22.980286 13991 tablet_replica.cc:330] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11: stopping tablet replica
I20260809 23:20:22.980285 13990 tablet_replica.cc:330] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f: stopping tablet replica
I20260809 23:20:22.980371 13991 raft_consensus.cc:2229] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:20:22.980373 13990 raft_consensus.cc:2229] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:20:22.980451 13991 raft_consensus.cc:2258] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:20:22.980430 13731 tablet_service.cc:1514] Processing DeleteTablet for tablet b6554a74516b431bbae0422a142c65e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:20:22 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:52516
I20260809 23:20:22.980459 13990 raft_consensus.cc:2258] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:20:22.980754 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 13524
I20260809 23:20:22.980859 13991 ts_tablet_manager.cc:1905] T b6554a74516b431bbae0422a142c65e5 P 99923de29a64445296e6d26debeaec11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:20:22.980887 13990 ts_tablet_manager.cc:1905] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:20:22.983034 13990 ts_tablet_manager.cc:1918] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:20:22.983120 13990 log.cc:1196] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/b6554a74516b431bbae0422a142c65e5
I20260809 23:20:22.983480 13990 ts_tablet_manager.cc:1939] T b6554a74516b431bbae0422a142c65e5 P 5dd6302e07954febb0394f86d8a95c6f: Deleting consensus metadata
I20260809 23:20:22.983965 13441 catalog_manager.cc:4841] TS 5dd6302e07954febb0394f86d8a95c6f (127.1.235.131:44723): tablet b6554a74516b431bbae0422a142c65e5 (table test-table [id=c47e651156bd4557a954632173c02ef1]) successfully deleted
I20260809 23:20:22.989943 13993 tablet_replica.cc:330] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a: stopping tablet replica
I20260809 23:20:22.990056 13993 raft_consensus.cc:2229] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:20:22.990170 13993 raft_consensus.cc:2258] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:20:22.990613 13993 ts_tablet_manager.cc:1905] T b6554a74516b431bbae0422a142c65e5 P dc9abbb5e8f24f5dbf503c53af59811a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 23:20:22.991288 13441 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.235.129:43193 (error 108)
I20260809 23:20:22.991572 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 13665
I20260809 23:20:22.997404 13956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.997276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:36425 (local address 127.0.0.1:52520)
0809 23:20:22.997321 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:22.997355 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.130:36425: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260809 23:20:22.997509 13956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:20:22.997346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:43193 (local address 127.0.0.1:54888)
0809 23:20:22.997472 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 23:20:22.997493 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.129:43193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260809 23:20:22.997618 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 13807
W20260809 23:20:22.997650 13444 catalog_manager.cc:4584] TS dc9abbb5e8f24f5dbf503c53af59811a (127.1.235.130:36425): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b6554a74516b431bbae0422a142c65e5: Network error: Client connection negotiation failed: client connection to 127.1.235.130:36425: connect: Connection refused (error 111)
I20260809 23:20:23.003273 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 13424
2026-08-09T23:20:23Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (1909 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:20:23 dist-test-slave-6nmv krb5kdc[13997](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:20:23 dist-test-slave-6nmv krb5kdc[13997](info): set up 2 sockets
Aug 09 23:20:23 dist-test-slave-6nmv krb5kdc[13997](info): commencing operation
krb5kdc: starting...
W20260809 23:20:24.032578 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.008s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:20:24 dist-test-slave-6nmv krb5kdc[13997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317624, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:20:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:20:24Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.1.235.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.1.235.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.1.235.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/rangeradmin_127.1.235.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.1.235.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/rangeradmin_127.1.235.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.1.235.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.1.235.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.1.235.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/rangerlookup_127.1.235.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.1.235.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/rangerlookup_127.1.235.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.235.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.1.235.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.235.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/HTTP_127.1.235.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.235.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/HTTP_127.1.235.148@KRBTEST.COM.keytab.
I20260809 23:20:24.184448 1966 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskGyHluD/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/postgres -l logfile start
2026-08-09 23:20:26.579 UTC [14031] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 23:20:26.579 UTC [14031] LOG: listening on IPv4 address "127.1.235.148", port 49657
2026-08-09 23:20:26.582 UTC [14031] LOG: listening on Unix socket "/tmp/.s.PGSQL.49657"
2026-08-09 23:20:26.603 UTC [14034] LOG: database system was shut down at 2026-08-09 23:20:25 UTC
2026-08-09 23:20:26.606 UTC [14031] LOG: database system is ready to accept connections
I20260809 23:20:27.573530 1966 mini_postgres.cc:96] Postgres bound to 49657
2026-08-09 23:20:27.580 UTC [14043] FATAL: database "slave" does not exist
127.1.235.148:49657 - accepting connections
I20260809 23:20:27.581671 1966 mini_ranger.cc:161] Starting Ranger...
I20260809 23:20:27.596247 1966 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 23:20:28.051301 1966 mini_ranger.cc:87] Created ranger Postgres database
I20260809 23:20:28.051388 1966 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ranger-admin
2026-08-09 23:20:28,346 [I] DB FLAVOR :POSTGRES
2026-08-09 23:20:28,347 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 23:20:28,347 [I] Checking connection..
2026-08-09 23:20:28,347 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 23:20:28,592 [I] Checking connection passed.
2026-08-09 23:20:28,593 [I] --------- Verifying version history table ---------
2026-08-09 23:20:28,593 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 23:20:28,840 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 23:20:28,841 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 23:20:29,100 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 23:20:29,100 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 23:20:29,100 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 23:20:29.340 UTC [14113] WARNING: there is no transaction in progress
2026-08-09 23:20:29,346 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 23:20:29,347 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 23:20:29,612 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 23:20:29,613 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 23:20:29,613 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 23:20:29,841 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 23:20:30,092 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-6nmv.c.gcp-upstream.internal','N') ;"
2026-08-09 23:20:30,325 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 23:20:30,580 [I] Table x_portal_user does not exist in database ranger
2026-08-09 23:20:30,581 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 23:20:30,817 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 23:20:30,818 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 23:20:31,072 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 23:20:31,298 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 23:20:31,298 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 23:20:32.241 UTC [14229] WARNING: there is no transaction in progress
2026-08-09 23:20:32.257 UTC [14229] WARNING: there is no transaction in progress
2026-08-09 23:20:32.273 UTC [14229] WARNING: there is no transaction in progress
2026-08-09 23:20:32.288 UTC [14229] WARNING: there is no transaction in progress
2026-08-09 23:20:32.305 UTC [14229] WARNING: there is no transaction in progress
2026-08-09 23:20:32.321 UTC [14229] WARNING: there is no transaction in progress
2026-08-09 23:20:32.371 UTC [14229] WARNING: there is no transaction in progress
2026-08-09 23:20:32.377 UTC [14229] WARNING: there is no transaction in progress
2026-08-09 23:20:32.389 UTC [14229] WARNING: there is no transaction in progress
2026-08-09 23:20:32.399 UTC [14229] WARNING: there is no transaction in progress
2026-08-09 23:20:32.409 UTC [14229] WARNING: there is no transaction in progress
2026-08-09 23:20:32.423 UTC [14229] WARNING: there is no transaction in progress
2026-08-09 23:20:32.433 UTC [14229] WARNING: there is no transaction in progress
2026-08-09 23:20:32.440 UTC [14229] WARNING: there is no transaction in progress
2026-08-09 23:20:32.447 UTC [14229] WARNING: there is no transaction in progress
2026-08-09 23:20:32.453 UTC [14229] WARNING: there is no transaction in progress
2026-08-09 23:20:33,067 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 23:20:33,068 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 23:20:33,311 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 23:20:33,312 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 23:20:33,536 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 23:20:33,536 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 23:20:33,783 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 23:20:33,784 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 23:20:34,017 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 23:20:34,264 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-6nmv.c.gcp-upstream.internal';"
2026-08-09 23:20:34,484 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 23:20:34,484 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 23:20:34,733 [I] DB_PATCHES have already been applied
I20260809 23:20:34.738735 1966 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ranger-admin:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskGyHluD/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 23:20:34.738798 1966 mini_ranger.cc:193] Using host: 127.1.235.148
I20260809 23:20:34.742311 1966 mini_ranger.cc:227] Ranger admin URL: http://127.1.235.148:39223
Aug 09, 2026 11:20:35 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 11:20:35 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 11:20:35 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 11:20:35 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 11:20:35 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 11:20:35 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 11:20:35 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 23:20:35.863057 1966 mini_ranger.cc:160] Time spent starting Ranger: real 8.281s user 0.000s sys 0.010s
Aug 09, 2026 11:20:56 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 11:20:56 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 11:20:56 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 11:20:56 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 11:20:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 11:20:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 11:20:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 11:20:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 11:20:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 11:20:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 11:20:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 11:20:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 11:20:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 11:20:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 11:20:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 11:20:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 11:20:56 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 11:20:57 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 23:20:57.978411 1966 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.1.235.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.1.235.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.1.235.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/rangerkms_127.1.235.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.1.235.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/rangerkms_127.1.235.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.235.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.1.235.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.235.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/HTTP_127.1.235.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.235.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/HTTP_127.1.235.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 23:20:58 dist-test-slave-6nmv krb5kdc[13997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317658, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 23:20:58.052431 1966 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 23:20:58.061688 1966 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 23:20:58.898100 1966 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 23:20:58.898188 1966 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ranger-kms
I20260809 23:20:58.898205 1966 mini_ranger_kms.cc:227] Using postgres at 127.1.235.148:49657
2026-08-09 23:20:59,107 [I] DB FLAVOR :POSTGRES
2026-08-09 23:20:59,107 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 23:20:59,107 [I] Checking connection
2026-08-09 23:20:59,107 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 23:20:59,344 [I] connection success
2026-08-09 23:20:59,345 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 23:20:59,345 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 23:20:59,345 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 23:20:59,576 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 23:20:59,576 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 23:20:59,577 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 23:20:59,577 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:49657/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 23:20:59,823 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 23:21:00.276383 1966 mini_ranger_kms.cc:310] Created kms service
I20260809 23:21:00.450480 1966 mini_ranger_kms.cc:326] Created kudu user
I20260809 23:21:00.492576 1966 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 23:21:00 dist-test-slave-6nmv krb5kdc[13997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317658, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
I20260809 23:21:00.888571 1966 mini_ranger_kms.cc:384] Added ranger policy
I20260809 23:21:00.888712 1966 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ranger-kms:/tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 23:21:00.888736 1966 mini_ranger_kms.cc:240] Using host: 127.1.235.148
I20260809 23:21:00.893162 1966 mini_ranger_kms.cc:276] Ranger KMS PID: 14423
I20260809 23:21:00.893260 1966 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.1.235.148:33047
Aug 09, 2026 11:21:02 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 11:21:02 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 11:21:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 11:21:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 11:21:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 11:21:02 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260809 23:21:03.266513 1966 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.214s user 0.014s sys 0.180s
I20260809 23:21:03.266637 1966 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 23:21:03.266728 1966 mini_ranger_kms.cc:401] 127.1.235.148:33047/kms/v1/keys
Aug 09 23:21:03 dist-test-slave-6nmv krb5kdc[13997](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786317663, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.235.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 09 23:21:03 dist-test-slave-6nmv krb5kdc[13997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317663, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.235.148@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
Aug 09 23:21:04 dist-test-slave-6nmv krb5kdc[13997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317663, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.235.148@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
Aug 09 23:21:06 dist-test-slave-6nmv krb5kdc[13997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317666, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:21:06.329156 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:37001
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:37001
--ranger_config_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.235.148:33047/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:21:06.409766 14479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:21:06.409989 14479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:21:06.410009 14479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:21:06.411172 14479 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:21:06.411216 14479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:21:06.411230 14479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:21:06.411242 14479 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:21:06.411254 14479 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:21:06.412923 14479 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/wal
--ranger_kms_url=127.1.235.148:33047/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:37001
--ranger_config_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:37001
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:21:06.413159 14479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:21:06.413380 14479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 23:21:06.418442 14479 server_base.cc:1034] running on GCE node
W20260809 23:21:06.418490 14484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:06.418490 14487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:06.418579 14485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:06.418874 14479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:21:06.419097 14479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:21:06.420234 14479 hybrid_clock.cc:648] HybridClock initialized: now 1786317666420209 us; error 40 us; skew 500 ppm
Aug 09 23:21:06 dist-test-slave-6nmv krb5kdc[13997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317666, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:21:06.422802 14479 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:21:06.423207 14479 webserver.cc:460] Webserver started at http://127.1.235.190:32857/ using document root <none> and password file <none>
I20260809 23:21:06.423425 14479 fs_manager.cc:359] Metadata directory not provided
I20260809 23:21:06.423461 14479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:21:06.423597 14479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 23:21:06 dist-test-slave-6nmv krb5kdc[13997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317666, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
I20260809 23:21:06.475697 14479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "5001c4cfab7c4c56b4c3ef91d726b347"
format_stamp: "Formatted at 2026-08-09 23:21:06 on dist-test-slave-6nmv"
server_key: "4561400e11ad5a526d52c6848fceb1b1"
server_key_iv: "f6a7101062289c21089d9c7e11729b74"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:06.476135 14479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "5001c4cfab7c4c56b4c3ef91d726b347"
format_stamp: "Formatted at 2026-08-09 23:21:06 on dist-test-slave-6nmv"
server_key: "4561400e11ad5a526d52c6848fceb1b1"
server_key_iv: "f6a7101062289c21089d9c7e11729b74"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:06.477592 14479 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:21:06.492651 14494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:06.492841 14479 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 23:21:06.492950 14479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "5001c4cfab7c4c56b4c3ef91d726b347"
format_stamp: "Formatted at 2026-08-09 23:21:06 on dist-test-slave-6nmv"
server_key: "4561400e11ad5a526d52c6848fceb1b1"
server_key_iv: "f6a7101062289c21089d9c7e11729b74"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:06.493042 14479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:21:06.517918 14479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:21:06.520151 14479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:21:06.520330 14479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:21:06.525496 14479 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:37001
I20260809 23:21:06.525580 14551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:37001 every 8 connection(s)
I20260809 23:21:06.526019 14479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:21:06.526808 14552 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:21:06.529999 14552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347: Bootstrap starting.
I20260809 23:21:06.530689 14552 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347: Neither blocks nor log segments found. Creating new log.
I20260809 23:21:06.531031 14552 log.cc:824] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347: Log is configured to *not* fsync() on all Append() calls
I20260809 23:21:06.531855 14552 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347: No bootstrap required, opened a new log
I20260809 23:21:06.534629 14552 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5001c4cfab7c4c56b4c3ef91d726b347" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37001 } }
I20260809 23:21:06.534807 14552 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:21:06.534844 14552 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5001c4cfab7c4c56b4c3ef91d726b347, State: Initialized, Role: FOLLOWER
I20260809 23:21:06.535009 14552 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5001c4cfab7c4c56b4c3ef91d726b347" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37001 } }
I20260809 23:21:06.535089 14552 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:21:06.535120 14552 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:21:06.535164 14552 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:21:06.535599 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 14479
I20260809 23:21:06.535722 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:21:06.535811 14552 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5001c4cfab7c4c56b4c3ef91d726b347" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37001 } }
I20260809 23:21:06.535939 1966 external_mini_cluster.cc:1428] Setting key 6f4b6a243b8770784778ecaea5e49b9b
I20260809 23:21:06.535941 14552 leader_election.cc:302] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5001c4cfab7c4c56b4c3ef91d726b347; no voters:
I20260809 23:21:06.536118 14552 leader_election.cc:288] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:21:06.536188 14555 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:21:06.536859 14555 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [term 1 LEADER]: Becoming Leader. State: Replica: 5001c4cfab7c4c56b4c3ef91d726b347, State: Running, Role: LEADER
I20260809 23:21:06.536952 14552 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:21:06.536989 14555 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5001c4cfab7c4c56b4c3ef91d726b347" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37001 } }
I20260809 23:21:06.537356 14555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5001c4cfab7c4c56b4c3ef91d726b347. Latest consensus state: current_term: 1 leader_uuid: "5001c4cfab7c4c56b4c3ef91d726b347" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5001c4cfab7c4c56b4c3ef91d726b347" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37001 } } }
I20260809 23:21:06.537581 14555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [sys.catalog]: This master's current role is: LEADER
I20260809 23:21:06.537511 14559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5001c4cfab7c4c56b4c3ef91d726b347" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5001c4cfab7c4c56b4c3ef91d726b347" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37001 } } }
I20260809 23:21:06.538008 14566 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:21:06.538556 14566 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:21:06.538578 14552 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 23:21:06.539183 14559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347 [sys.catalog]: This master's current role is: LEADER
I20260809 23:21:06.543550 14566 catalog_manager.cc:1347] Generated new cluster ID: e01dd3355cb6411fa21fb8a34a9d77a3
I20260809 23:21:06.543638 14566 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 23:21:06 dist-test-slave-6nmv krb5kdc[13997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317666, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:21:06.555925 14557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:06.536454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53692 (local address 127.1.235.190:37001)
0809 23:21:06.544978 (+ 8524us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:06.544986 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:06.545021 (+ 35us) server_negotiation.cc:407] Connection header received
0809 23:21:06.545177 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:06.545184 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:06.545241 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:06.545436 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:06.546117 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:06.547639 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:06.548685 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:06.549390 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:06.549517 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:06.552213 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:06.552217 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:06.552217 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:06.552230 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:06.554380 (+ 2150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:06.554732 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:06.554735 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:06.554735 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:06.554838 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:06.555021 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:06.555022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:06.555022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:06.555331 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:06.555480 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:06.555576 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 23:21:06.555683 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8471,"thread_start_us":96,"threads_started":1}
I20260809 23:21:06.560420 14566 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:21:06.561126 14566 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:21:06.566810 14566 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347: Generated new TSK 0
I20260809 23:21:06.566958 14566 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:21:07.237702 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.235.148:33047/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:37001
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:21:07.343780 14601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:21:07.344022 14601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:21:07.344058 14601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:21:07.345214 14601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:21:07.345286 14601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:21:07.345330 14601 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:21:07.346887 14601 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.1.235.148:33047/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:37001
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:21:07.347220 14601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:21:07.347451 14601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:21:07.352571 14607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:07.352607 14610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:07.352613 14608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:07.352802 14601 server_base.cc:1034] running on GCE node
I20260809 23:21:07.353006 14601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:21:07.353262 14601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:21:07.354408 14601 hybrid_clock.cc:648] HybridClock initialized: now 1786317667354382 us; error 39 us; skew 500 ppm
Aug 09 23:21:07 dist-test-slave-6nmv krb5kdc[13997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317667, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:21:07.357501 14601 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:21:07.358063 14601 webserver.cc:460] Webserver started at http://127.1.235.129:41303/ using document root <none> and password file <none>
I20260809 23:21:07.358350 14601 fs_manager.cc:359] Metadata directory not provided
I20260809 23:21:07.358441 14601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:21:07.358631 14601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 23:21:07 dist-test-slave-6nmv krb5kdc[13997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317667, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
I20260809 23:21:07.371951 14601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "9bb34f048de14e03bc95b286ea8f0c08"
format_stamp: "Formatted at 2026-08-09 23:21:07 on dist-test-slave-6nmv"
server_key: "c3b351de7b33397965cc538b10b75c48"
server_key_iv: "7e78f52a0b6964b72f304a8eb2268ada"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:07.372527 14601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "9bb34f048de14e03bc95b286ea8f0c08"
format_stamp: "Formatted at 2026-08-09 23:21:07 on dist-test-slave-6nmv"
server_key: "c3b351de7b33397965cc538b10b75c48"
server_key_iv: "7e78f52a0b6964b72f304a8eb2268ada"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:07.381281 14601 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.002s sys 0.000s
I20260809 23:21:07.400359 14619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:07.400911 14601 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.001s sys 0.000s
I20260809 23:21:07.401031 14601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "9bb34f048de14e03bc95b286ea8f0c08"
format_stamp: "Formatted at 2026-08-09 23:21:07 on dist-test-slave-6nmv"
server_key: "c3b351de7b33397965cc538b10b75c48"
server_key_iv: "7e78f52a0b6964b72f304a8eb2268ada"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:07.401154 14601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:21:07.411505 14601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:21:07.413681 14601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:21:07.413882 14601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:21:07.414165 14601 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:21:07.414546 14601 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:21:07.414603 14601 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:07.414723 14601 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:21:07.414755 14601 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:07.422664 14601 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:39937
I20260809 23:21:07.422760 14742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:39937 every 8 connection(s)
I20260809 23:21:07.423056 14601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:21:07.424960 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 14601
I20260809 23:21:07.425087 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:21:07.425251 1966 external_mini_cluster.cc:1428] Setting key e9997bf4511913534fe679a13a9d7662
Aug 09 23:21:07 dist-test-slave-6nmv krb5kdc[13997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317667, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:21:07.434990 14746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:07.423797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:60693 (local address 127.1.235.190:37001)
0809 23:21:07.423949 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:07.423951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:07.424163 (+ 212us) server_negotiation.cc:407] Connection header received
0809 23:21:07.424871 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:07.424873 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:07.424889 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:07.425000 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:07.425853 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.426509 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.427946 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.428260 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.428335 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:07.431135 (+ 2800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:07.431137 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:07.431137 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:07.431145 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:07.433289 (+ 2144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:07.433783 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:07.433784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:07.433784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:07.433888 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:07.434210 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:07.434211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:07.434212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:07.434354 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:07.434433 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:07.434784 (+ 351us) server_negotiation.cc:299] Negotiation successful
0809 23:21:07.434884 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
I20260809 23:21:07.435282 14745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:07.423782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:37001 (local address 127.1.235.129:60693)
0809 23:21:07.424008 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:07.424060 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:07.424745 (+ 685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:07.425101 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:07.425105 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:07.425383 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:07.425646 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:07.425653 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.426632 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.426633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:07.427815 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:07.427818 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.428421 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.428422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:07.428601 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:07.429158 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:07.429168 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:07.431006 (+ 1838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:07.433393 (+ 2387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:07.433400 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:07.433402 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:07.433690 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:07.433973 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:07.433974 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:07.433974 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:07.434119 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:07.434448 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:07.434454 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:07.434612 (+ 158us) client_negotiation.cc:769] Sending connection context
0809 23:21:07.434735 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 23:21:07.434884 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":85,"threads_started":1}
I20260809 23:21:07.435863 14743 heartbeater.cc:347] Connected to a master server at 127.1.235.190:37001
I20260809 23:21:07.435954 14743 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:07.436117 14743 heartbeater.cc:511] Master 127.1.235.190:37001 requested a full tablet report, sending...
I20260809 23:21:07.436676 14512 ts_manager.cc:194] Registered new tserver with Master: 9bb34f048de14e03bc95b286ea8f0c08 (127.1.235.129:39937)
I20260809 23:21:07.437386 14512 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:60693
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:21:07.453482 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.235.148:33047/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:37001
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 23:21:07 dist-test-slave-6nmv krb5kdc[13997](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786317667, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 23:21:07.578472 14750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:21:07.578730 14750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:21:07.578768 14750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:21:07.580350 14750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:21:07.580420 14750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:21:07.580463 14750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:21:07.582474 14750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.1.235.148:33047/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:37001
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14750
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:21:07.582700 14750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:21:07.583019 14750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:21:07.589495 14757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:07.589519 14758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:07.589974 14750 server_base.cc:1034] running on GCE node
W20260809 23:21:07.590107 14760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:07.590395 14750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:21:07.590719 14750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:21:07.591898 14750 hybrid_clock.cc:648] HybridClock initialized: now 1786317667591879 us; error 35 us; skew 500 ppm
Aug 09 23:21:07 dist-test-slave-6nmv krb5kdc[13997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317667, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:21:07.594861 14750 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:21:07.595397 14750 webserver.cc:460] Webserver started at http://127.1.235.130:37157/ using document root <none> and password file <none>
I20260809 23:21:07.595655 14750 fs_manager.cc:359] Metadata directory not provided
I20260809 23:21:07.595764 14750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:21:07.595907 14750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 23:21:07 dist-test-slave-6nmv krb5kdc[13997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317667, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
I20260809 23:21:07.611186 14750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "c31aca6be61a48b59a2890920038a851"
format_stamp: "Formatted at 2026-08-09 23:21:07 on dist-test-slave-6nmv"
server_key: "6d8b1af3703ada52077cbea8a9cc1da5"
server_key_iv: "d3ee6303b2e0785e9f97e916dedbbe0b"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:07.611815 14750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "c31aca6be61a48b59a2890920038a851"
format_stamp: "Formatted at 2026-08-09 23:21:07 on dist-test-slave-6nmv"
server_key: "6d8b1af3703ada52077cbea8a9cc1da5"
server_key_iv: "d3ee6303b2e0785e9f97e916dedbbe0b"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:07.613827 14750 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 23:21:07.631403 14767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:07.631649 14750 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.000s sys 0.001s
I20260809 23:21:07.631779 14750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "c31aca6be61a48b59a2890920038a851"
format_stamp: "Formatted at 2026-08-09 23:21:07 on dist-test-slave-6nmv"
server_key: "6d8b1af3703ada52077cbea8a9cc1da5"
server_key_iv: "d3ee6303b2e0785e9f97e916dedbbe0b"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:07.631933 14750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:21:07.651594 14750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:21:07.654201 14750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:21:07.654419 14750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:21:07.654740 14750 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:21:07.655161 14750 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:21:07.655252 14750 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:07.655326 14750 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:21:07.655397 14750 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:07.664180 14750 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:41787
I20260809 23:21:07.664628 14750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:21:07.665645 14891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:41787 every 8 connection(s)
I20260809 23:21:07.667066 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 14750
I20260809 23:21:07.667169 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:21:07.667359 1966 external_mini_cluster.cc:1428] Setting key 47a130d95a10f0782d56948283e6378f
Aug 09 23:21:07 dist-test-slave-6nmv krb5kdc[13997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317667, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:21:07.677524 14746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:07.666562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:50109 (local address 127.1.235.190:37001)
0809 23:21:07.666611 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:07.666613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:07.667084 (+ 471us) server_negotiation.cc:407] Connection header received
0809 23:21:07.667920 (+ 836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:07.667921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:07.667934 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:07.667967 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:07.668751 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.669461 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.670983 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.671298 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.671345 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:07.674164 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:07.674165 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:07.674165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:07.674173 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:07.675873 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:07.676401 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:07.676402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:07.676402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:07.676463 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:07.676770 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:07.676770 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:07.676771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:07.676923 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:07.676970 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:07.677324 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 23:21:07.677409 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 23:21:07.678277 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:07.666275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:37001 (local address 127.1.235.130:50109)
0809 23:21:07.666956 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:07.666998 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:07.667775 (+ 777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:07.668137 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:07.668140 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:07.668390 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:07.668636 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:07.668641 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.669584 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.669585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:07.670812 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:07.670815 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.671449 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.671450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:07.671601 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:07.672221 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:07.672231 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:07.674052 (+ 1821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:07.675973 (+ 1921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:07.675979 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:07.675982 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:07.676262 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:07.676558 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:07.676558 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:07.676559 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:07.676695 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:07.677021 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:07.677026 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:07.677176 (+ 150us) client_negotiation.cc:769] Sending connection context
0809 23:21:07.677902 (+ 726us) client_negotiation.cc:240] Negotiation successful
0809 23:21:07.678054 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":86,"threads_started":1}
I20260809 23:21:07.679020 14893 heartbeater.cc:347] Connected to a master server at 127.1.235.190:37001
I20260809 23:21:07.679104 14893 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:07.679267 14893 heartbeater.cc:511] Master 127.1.235.190:37001 requested a full tablet report, sending...
I20260809 23:21:07.679646 14512 ts_manager.cc:194] Registered new tserver with Master: c31aca6be61a48b59a2890920038a851 (127.1.235.130:41787)
I20260809 23:21:07.680128 14512 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:50109
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:21:07.714447 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.235.148:33047/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:37001
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:21:07.829532 14898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:21:07.829737 14898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:21:07.829773 14898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:21:07.830899 14898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:21:07.830981 14898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:21:07.831027 14898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:21:07.832557 14898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.1.235.148:33047/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:37001
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:21:07.832819 14898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:21:07.833045 14898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:21:07.841467 14906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:07.841696 14898 server_base.cc:1034] running on GCE node
W20260809 23:21:07.841871 14904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:07.842062 14903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:07.842305 14898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:21:07.842531 14898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:21:07.849903 14898 hybrid_clock.cc:648] HybridClock initialized: now 1786317667849867 us; error 26 us; skew 500 ppm
Aug 09 23:21:07 dist-test-slave-6nmv krb5kdc[13997](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317667, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:21:07.853140 14898 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:21:07.853593 14898 webserver.cc:460] Webserver started at http://127.1.235.131:33317/ using document root <none> and password file <none>
I20260809 23:21:07.853855 14898 fs_manager.cc:359] Metadata directory not provided
I20260809 23:21:07.853924 14898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:21:07.854043 14898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 23:21:07 dist-test-slave-6nmv krb5kdc[13997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317667, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
I20260809 23:21:07.871798 14898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "aed3658682e342cc81369f5e78aa53c9"
format_stamp: "Formatted at 2026-08-09 23:21:07 on dist-test-slave-6nmv"
server_key: "1f8944ada28bba0620a951f8a404478b"
server_key_iv: "9eedcdb64b517358087dd9b5ce3a7c14"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:07.872391 14898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "aed3658682e342cc81369f5e78aa53c9"
format_stamp: "Formatted at 2026-08-09 23:21:07 on dist-test-slave-6nmv"
server_key: "1f8944ada28bba0620a951f8a404478b"
server_key_iv: "9eedcdb64b517358087dd9b5ce3a7c14"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:07.874487 14898 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260809 23:21:07.891742 14915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:07.892000 14898 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260809 23:21:07.892098 14898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "aed3658682e342cc81369f5e78aa53c9"
format_stamp: "Formatted at 2026-08-09 23:21:07 on dist-test-slave-6nmv"
server_key: "1f8944ada28bba0620a951f8a404478b"
server_key_iv: "9eedcdb64b517358087dd9b5ce3a7c14"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:07.892189 14898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:21:07.925940 14898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:21:07.928332 14898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:21:07.928532 14898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:21:07.928782 14898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:21:07.929181 14898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:21:07.929252 14898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:07.929298 14898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:21:07.929327 14898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:07.938822 14898 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:41449
I20260809 23:21:07.939337 14898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:21:07.946342 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 14898
I20260809 23:21:07.946455 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:21:07.946652 1966 external_mini_cluster.cc:1428] Setting key 35a36e8788a1902c0a837bd28e2e6da1
I20260809 23:21:07.947037 15035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:41449 every 8 connection(s)
Aug 09 23:21:07 dist-test-slave-6nmv krb5kdc[13997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317667, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:21:07.962939 14746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:07.949344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:58483 (local address 127.1.235.190:37001)
0809 23:21:07.949410 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:07.949412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:07.949917 (+ 505us) server_negotiation.cc:407] Connection header received
0809 23:21:07.950609 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:07.950610 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:07.950622 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:07.950653 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:07.951500 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.952338 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.954101 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.954412 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.954457 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:07.959224 (+ 4767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:07.959225 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:07.959225 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:07.959233 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:07.960896 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:07.961814 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:07.961815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:07.961815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:07.961905 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:07.962203 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:07.962204 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:07.962204 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:07.962339 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:07.962408 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:07.962770 (+ 362us) server_negotiation.cc:299] Negotiation successful
0809 23:21:07.962852 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 23:21:07.963404 15038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:07.949339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:37001 (local address 127.1.235.131:58483)
0809 23:21:07.949762 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:07.949804 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:07.950482 (+ 678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:07.950836 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:07.950840 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:07.951102 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:07.951375 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:07.951381 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.952583 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.952584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:07.953999 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:07.954002 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.954548 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.954548 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:07.954689 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:07.957257 (+ 2568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:07.957266 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:07.959133 (+ 1867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:07.961390 (+ 2257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:07.961408 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:07.961410 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:07.961715 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:07.961984 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:07.961985 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:07.961985 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:07.962117 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:07.962444 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:07.962451 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:07.962602 (+ 151us) client_negotiation.cc:769] Sending connection context
0809 23:21:07.963034 (+ 432us) client_negotiation.cc:240] Negotiation successful
0809 23:21:07.963184 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":228,"threads_started":1}
I20260809 23:21:07.964165 15036 heartbeater.cc:347] Connected to a master server at 127.1.235.190:37001
I20260809 23:21:07.964253 15036 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:07.964453 15036 heartbeater.cc:511] Master 127.1.235.190:37001 requested a full tablet report, sending...
I20260809 23:21:07.964807 14512 ts_manager.cc:194] Registered new tserver with Master: aed3658682e342cc81369f5e78aa53c9 (127.1.235.131:41449)
I20260809 23:21:07.965272 14512 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:58483
I20260809 23:21:07.969671 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:21:07.979264 14746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:07.971480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53694 (local address 127.1.235.190:37001)
0809 23:21:07.971517 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:07.971519 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:07.971879 (+ 360us) server_negotiation.cc:407] Connection header received
0809 23:21:07.971983 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:07.971984 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:07.971994 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:07.972024 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:07.972836 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.973559 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.974661 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.974931 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.974975 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:07.976479 (+ 1504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:07.976481 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:07.976481 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:07.976488 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:07.978087 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:07.978481 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:07.978482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:07.978482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:07.978536 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:07.978733 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:07.978733 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:07.978734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:07.978854 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:07.978933 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:07.979121 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 23:21:07.979189 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 23:21:07.981408 14512 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53694:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:21:07.983680 14512 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:21:07.998262 15050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:07.986819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38962 (local address 127.1.235.130:41787)
0809 23:21:07.987852 (+ 1033us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:07.987857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:07.988158 (+ 301us) server_negotiation.cc:407] Connection header received
0809 23:21:07.988307 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:07.988310 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:07.988325 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:07.988372 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:21:07.988748 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.990157 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.996334 (+ 6177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.997220 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.997272 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:07.997395 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:07.998130 (+ 735us) server_negotiation.cc:299] Negotiation successful
0809 23:21:07.998177 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":994,"thread_start_us":95,"threads_started":1}
I20260809 23:21:08.000080 15052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:07.986704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:41787 (local address 127.0.0.1:38962)
0809 23:21:07.988054 (+ 1350us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:07.988090 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:07.988193 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:07.988600 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:07.988602 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:07.988604 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:21:07.988667 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:07.988668 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.990256 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.990257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:07.991597 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:07.991600 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.997458 (+ 5858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.997458 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:07.997554 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:07.997569 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 23:21:07.997638 (+ 69us) client_negotiation.cc:240] Negotiation successful
0809 23:21:07.997688 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1322,"thread_start_us":75,"threads_started":1}
I20260809 23:21:08.000973 14813 tablet_service.cc:1467] Processing CreateTablet for tablet 6d6b29e000f74d79b05bf45e28d68167 (DEFAULT_TABLE table=test-table [id=9e2c8e2025fe4e4faf8690054e67e7d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:21:08.001389 14813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d6b29e000f74d79b05bf45e28d68167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:21:08.003286 15049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:07.986917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:39937 (local address 127.0.0.1:59694)
0809 23:21:07.992020 (+ 5103us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:07.992030 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:07.992074 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:07.994055 (+ 1981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:07.994056 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:07.994058 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:21:07.994092 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:07.994093 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:08.000708 (+ 6615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:08.000708 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:08.001898 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:08.001901 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:08.003068 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:08.003068 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:08.003132 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:08.003136 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:21:08.003184 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 23:21:08.003217 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5085,"thread_start_us":66,"threads_started":1}
I20260809 23:21:08.003795 15051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:07.987058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:41449 (local address 127.0.0.1:49668)
0809 23:21:07.992142 (+ 5084us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:07.992150 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:07.992187 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:07.992451 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:07.992452 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:07.992453 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:21:07.992509 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:07.992510 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.994152 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.994152 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:07.999081 (+ 4929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:07.999084 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:08.003592 (+ 4508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:08.003593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:08.003653 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:08.003658 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 23:21:08.003703 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 23:21:08.003737 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5073,"thread_start_us":70,"threads_started":1}
I20260809 23:21:08.004112 15056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:07.987359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49668 (local address 127.1.235.131:41449)
0809 23:21:07.987967 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:07.987970 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:07.992238 (+ 4268us) server_negotiation.cc:407] Connection header received
0809 23:21:07.992282 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:07.992285 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:07.992301 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:07.992371 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:21:07.992591 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.993637 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.999210 (+ 5573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:07.999891 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:07.999955 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:08.000016 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:08.003987 (+ 3971us) server_negotiation.cc:299] Negotiation successful
0809 23:21:08.004029 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":173,"threads_started":1}
I20260809 23:21:08.004904 14950 tablet_service.cc:1467] Processing CreateTablet for tablet 6d6b29e000f74d79b05bf45e28d68167 (DEFAULT_TABLE table=test-table [id=9e2c8e2025fe4e4faf8690054e67e7d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:21:08.005193 14950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d6b29e000f74d79b05bf45e28d68167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:21:08.009377 15054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:07.987379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59694 (local address 127.1.235.129:39937)
0809 23:21:07.993824 (+ 6445us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:07.993829 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:07.993839 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:21:07.993905 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:07.993907 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:07.993921 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:07.993987 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:21:07.994783 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:08.000619 (+ 5836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:08.002249 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:08.002920 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:08.002986 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:08.003033 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:08.009232 (+ 6199us) server_negotiation.cc:299] Negotiation successful
0809 23:21:08.009280 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6409,"thread_start_us":66,"threads_started":1}
I20260809 23:21:08.010128 14672 tablet_service.cc:1467] Processing CreateTablet for tablet 6d6b29e000f74d79b05bf45e28d68167 (DEFAULT_TABLE table=test-table [id=9e2c8e2025fe4e4faf8690054e67e7d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:21:08.010481 14672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d6b29e000f74d79b05bf45e28d68167. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:21:08.013304 15058 tablet_bootstrap.cc:492] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9: Bootstrap starting.
I20260809 23:21:08.014132 15059 tablet_bootstrap.cc:492] T 6d6b29e000f74d79b05bf45e28d68167 P 9bb34f048de14e03bc95b286ea8f0c08: Bootstrap starting.
I20260809 23:21:08.014366 15058 tablet_bootstrap.cc:654] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9: Neither blocks nor log segments found. Creating new log.
I20260809 23:21:08.014925 15059 tablet_bootstrap.cc:654] T 6d6b29e000f74d79b05bf45e28d68167 P 9bb34f048de14e03bc95b286ea8f0c08: Neither blocks nor log segments found. Creating new log.
I20260809 23:21:08.015709 15059 log.cc:824] T 6d6b29e000f74d79b05bf45e28d68167 P 9bb34f048de14e03bc95b286ea8f0c08: Log is configured to *not* fsync() on all Append() calls
I20260809 23:21:08.016098 15057 tablet_bootstrap.cc:492] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851: Bootstrap starting.
I20260809 23:21:08.017270 15057 tablet_bootstrap.cc:654] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851: Neither blocks nor log segments found. Creating new log.
I20260809 23:21:08.017623 15058 log.cc:824] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9: Log is configured to *not* fsync() on all Append() calls
I20260809 23:21:08.017683 15057 log.cc:824] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851: Log is configured to *not* fsync() on all Append() calls
I20260809 23:21:08.018529 15059 tablet_bootstrap.cc:492] T 6d6b29e000f74d79b05bf45e28d68167 P 9bb34f048de14e03bc95b286ea8f0c08: No bootstrap required, opened a new log
I20260809 23:21:08.018637 15059 ts_tablet_manager.cc:1397] T 6d6b29e000f74d79b05bf45e28d68167 P 9bb34f048de14e03bc95b286ea8f0c08: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 23:21:08.021173 15059 raft_consensus.cc:348] T 6d6b29e000f74d79b05bf45e28d68167 P 9bb34f048de14e03bc95b286ea8f0c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31aca6be61a48b59a2890920038a851" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41787 } } peers { permanent_uuid: "9bb34f048de14e03bc95b286ea8f0c08" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39937 } } peers { permanent_uuid: "aed3658682e342cc81369f5e78aa53c9" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41449 } }
I20260809 23:21:08.021447 15059 raft_consensus.cc:374] T 6d6b29e000f74d79b05bf45e28d68167 P 9bb34f048de14e03bc95b286ea8f0c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:21:08.021554 15059 raft_consensus.cc:729] T 6d6b29e000f74d79b05bf45e28d68167 P 9bb34f048de14e03bc95b286ea8f0c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bb34f048de14e03bc95b286ea8f0c08, State: Initialized, Role: FOLLOWER
I20260809 23:21:08.021742 15059 consensus_queue.cc:260] T 6d6b29e000f74d79b05bf45e28d68167 P 9bb34f048de14e03bc95b286ea8f0c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31aca6be61a48b59a2890920038a851" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41787 } } peers { permanent_uuid: "9bb34f048de14e03bc95b286ea8f0c08" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39937 } } peers { permanent_uuid: "aed3658682e342cc81369f5e78aa53c9" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41449 } }
I20260809 23:21:08.022089 15059 ts_tablet_manager.cc:1428] T 6d6b29e000f74d79b05bf45e28d68167 P 9bb34f048de14e03bc95b286ea8f0c08: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:21:08.022244 14743 heartbeater.cc:503] Master 127.1.235.190:37001 was elected leader, sending a full tablet report...
I20260809 23:21:08.023876 15057 tablet_bootstrap.cc:492] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851: No bootstrap required, opened a new log
I20260809 23:21:08.024006 15057 ts_tablet_manager.cc:1397] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260809 23:21:08.026111 15057 raft_consensus.cc:348] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31aca6be61a48b59a2890920038a851" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41787 } } peers { permanent_uuid: "9bb34f048de14e03bc95b286ea8f0c08" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39937 } } peers { permanent_uuid: "aed3658682e342cc81369f5e78aa53c9" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41449 } }
I20260809 23:21:08.026326 15057 raft_consensus.cc:374] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:21:08.026407 15057 raft_consensus.cc:729] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c31aca6be61a48b59a2890920038a851, State: Initialized, Role: FOLLOWER
I20260809 23:21:08.026567 15057 consensus_queue.cc:260] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31aca6be61a48b59a2890920038a851" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41787 } } peers { permanent_uuid: "9bb34f048de14e03bc95b286ea8f0c08" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39937 } } peers { permanent_uuid: "aed3658682e342cc81369f5e78aa53c9" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41449 } }
I20260809 23:21:08.026834 15057 ts_tablet_manager.cc:1428] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260809 23:21:08.026971 14893 heartbeater.cc:503] Master 127.1.235.190:37001 was elected leader, sending a full tablet report...
I20260809 23:21:08.027513 15058 tablet_bootstrap.cc:492] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9: No bootstrap required, opened a new log
I20260809 23:21:08.027581 15058 ts_tablet_manager.cc:1397] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20260809 23:21:08.029625 15058 raft_consensus.cc:348] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31aca6be61a48b59a2890920038a851" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41787 } } peers { permanent_uuid: "9bb34f048de14e03bc95b286ea8f0c08" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39937 } } peers { permanent_uuid: "aed3658682e342cc81369f5e78aa53c9" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41449 } }
I20260809 23:21:08.029850 15058 raft_consensus.cc:374] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:21:08.029943 15058 raft_consensus.cc:729] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aed3658682e342cc81369f5e78aa53c9, State: Initialized, Role: FOLLOWER
I20260809 23:21:08.030112 15058 consensus_queue.cc:260] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31aca6be61a48b59a2890920038a851" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41787 } } peers { permanent_uuid: "9bb34f048de14e03bc95b286ea8f0c08" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39937 } } peers { permanent_uuid: "aed3658682e342cc81369f5e78aa53c9" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41449 } }
I20260809 23:21:08.030414 15058 ts_tablet_manager.cc:1428] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 23:21:08.030557 15036 heartbeater.cc:503] Master 127.1.235.190:37001 was elected leader, sending a full tablet report...
I20260809 23:21:08.059432 15066 raft_consensus.cc:482] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:21:08.059644 15066 raft_consensus.cc:504] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31aca6be61a48b59a2890920038a851" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41787 } } peers { permanent_uuid: "9bb34f048de14e03bc95b286ea8f0c08" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39937 } } peers { permanent_uuid: "aed3658682e342cc81369f5e78aa53c9" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41449 } }
I20260809 23:21:08.064261 15038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:08.060649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:41787 (local address 127.1.235.131:50103)
0809 23:21:08.060768 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:08.060779 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:08.060819 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:08.061092 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:08.061093 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:08.061095 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:21:08.061164 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:08.061165 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:08.062180 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:08.062181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:08.063324 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:08.063327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:08.064034 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:08.064035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:08.064111 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:08.064114 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:21:08.064156 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 23:21:08.064191 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99}
I20260809 23:21:08.064666 15050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:08.060899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:50103 (local address 127.1.235.130:41787)
0809 23:21:08.060958 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:08.060960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:08.060967 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:21:08.060991 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:08.060992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:08.061001 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:08.061044 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:21:08.061230 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:08.062062 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:08.063426 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:08.063927 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:08.063994 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:08.064002 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:08.064569 (+ 567us) server_negotiation.cc:299] Negotiation successful
0809 23:21:08.064608 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 23:21:08.064967 14838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d6b29e000f74d79b05bf45e28d68167" candidate_uuid: "aed3658682e342cc81369f5e78aa53c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c31aca6be61a48b59a2890920038a851" is_pre_election: true
I20260809 23:21:08.065121 14838 raft_consensus.cc:2454] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aed3658682e342cc81369f5e78aa53c9 in term 0.
I20260809 23:21:08.065536 14919 leader_election.cc:302] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aed3658682e342cc81369f5e78aa53c9, c31aca6be61a48b59a2890920038a851; no voters:
I20260809 23:21:08.068696 15038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:08.065132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:39937 (local address 127.1.235.131:48447)
0809 23:21:08.065841 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:08.065851 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:08.065893 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:08.066056 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:08.066057 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:08.066058 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:21:08.066084 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:08.066085 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:08.066874 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:08.066875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:08.067812 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:08.067814 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:08.068519 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:08.068519 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:08.068571 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:08.068574 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:21:08.068611 (+ 37us) client_negotiation.cc:240] Negotiation successful
0809 23:21:08.068639 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681}
I20260809 23:21:08.068992 15054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:08.065228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:48447 (local address 127.1.235.129:39937)
0809 23:21:08.065280 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:08.065282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:08.065951 (+ 669us) server_negotiation.cc:407] Connection header received
0809 23:21:08.065976 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:08.065978 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:08.065986 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:08.066022 (+ 36us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:21:08.066136 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:08.066788 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:08.067901 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:08.068421 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:08.068482 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:08.068490 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:08.068881 (+ 391us) server_negotiation.cc:299] Negotiation successful
0809 23:21:08.068934 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 23:21:08.069399 14694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d6b29e000f74d79b05bf45e28d68167" candidate_uuid: "aed3658682e342cc81369f5e78aa53c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bb34f048de14e03bc95b286ea8f0c08" is_pre_election: true
I20260809 23:21:08.069520 14694 raft_consensus.cc:2454] T 6d6b29e000f74d79b05bf45e28d68167 P 9bb34f048de14e03bc95b286ea8f0c08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aed3658682e342cc81369f5e78aa53c9 in term 0.
I20260809 23:21:08.069759 15066 leader_election.cc:288] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c31aca6be61a48b59a2890920038a851 (127.1.235.130:41787), 9bb34f048de14e03bc95b286ea8f0c08 (127.1.235.129:39937)
I20260809 23:21:08.069875 15067 raft_consensus.cc:2781] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:21:08.069988 15067 raft_consensus.cc:482] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:21:08.070055 15067 raft_consensus.cc:3037] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:21:08.071074 15067 raft_consensus.cc:504] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31aca6be61a48b59a2890920038a851" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41787 } } peers { permanent_uuid: "9bb34f048de14e03bc95b286ea8f0c08" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39937 } } peers { permanent_uuid: "aed3658682e342cc81369f5e78aa53c9" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41449 } }
I20260809 23:21:08.073542 14838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d6b29e000f74d79b05bf45e28d68167" candidate_uuid: "aed3658682e342cc81369f5e78aa53c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c31aca6be61a48b59a2890920038a851"
I20260809 23:21:08.073621 14838 raft_consensus.cc:3037] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:21:08.074462 14838 raft_consensus.cc:2454] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aed3658682e342cc81369f5e78aa53c9 in term 1.
I20260809 23:21:08.074712 14919 leader_election.cc:302] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aed3658682e342cc81369f5e78aa53c9, c31aca6be61a48b59a2890920038a851; no voters:
I20260809 23:21:08.074818 15066 raft_consensus.cc:2781] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:21:08.074985 15066 raft_consensus.cc:686] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [term 1 LEADER]: Becoming Leader. State: Replica: aed3658682e342cc81369f5e78aa53c9, State: Running, Role: LEADER
I20260809 23:21:08.075095 15066 consensus_queue.cc:237] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31aca6be61a48b59a2890920038a851" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41787 } } peers { permanent_uuid: "9bb34f048de14e03bc95b286ea8f0c08" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39937 } } peers { permanent_uuid: "aed3658682e342cc81369f5e78aa53c9" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41449 } }
I20260809 23:21:08.075989 14512 catalog_manager.cc:5495] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to aed3658682e342cc81369f5e78aa53c9 (127.1.235.131). New cstate: current_term: 1 leader_uuid: "aed3658682e342cc81369f5e78aa53c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c31aca6be61a48b59a2890920038a851" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bb34f048de14e03bc95b286ea8f0c08" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aed3658682e342cc81369f5e78aa53c9" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41449 } health_report { overall_health: HEALTHY } } }
I20260809 23:21:08.077087 14694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d6b29e000f74d79b05bf45e28d68167" candidate_uuid: "aed3658682e342cc81369f5e78aa53c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bb34f048de14e03bc95b286ea8f0c08"
I20260809 23:21:08.077160 14694 raft_consensus.cc:3037] T 6d6b29e000f74d79b05bf45e28d68167 P 9bb34f048de14e03bc95b286ea8f0c08 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:21:08.077981 14694 raft_consensus.cc:2454] T 6d6b29e000f74d79b05bf45e28d68167 P 9bb34f048de14e03bc95b286ea8f0c08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aed3658682e342cc81369f5e78aa53c9 in term 1.
I20260809 23:21:08.078192 15067 leader_election.cc:288] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [CANDIDATE]: Term 1 election: Requested vote from peers c31aca6be61a48b59a2890920038a851 (127.1.235.130:41787), 9bb34f048de14e03bc95b286ea8f0c08 (127.1.235.129:39937)
I20260809 23:21:08.083840 15056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:08.080935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49678 (local address 127.1.235.131:41449)
0809 23:21:08.080977 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:08.080979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:08.080988 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:21:08.081044 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:08.081045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:08.081060 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:08.081144 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:21:08.081257 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:08.081940 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:08.082931 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:08.083231 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:08.083297 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:08.083479 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:21:08.083581 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:21:08.083653 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:08.083743 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 23:21:08.083762 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 23:21:08.085623 14694 raft_consensus.cc:1261] T 6d6b29e000f74d79b05bf45e28d68167 P 9bb34f048de14e03bc95b286ea8f0c08 [term 1 FOLLOWER]: Refusing update from remote peer aed3658682e342cc81369f5e78aa53c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:21:08.085894 14838 raft_consensus.cc:1261] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851 [term 1 FOLLOWER]: Refusing update from remote peer aed3658682e342cc81369f5e78aa53c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:21:08.086297 15066 consensus_queue.cc:1035] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c31aca6be61a48b59a2890920038a851" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 41787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:21:08.086440 15066 consensus_queue.cc:1035] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bb34f048de14e03bc95b286ea8f0c08" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:21:08.093678 15071 mvcc.cc:205] Tried to move back new op lower bound from 7316757168475996160 to 7316757168436682752. Current Snapshot: MvccSnapshot[applied={T|T < 7316757168475996160}]
I20260809 23:21:08.093827 15074 mvcc.cc:205] Tried to move back new op lower bound from 7316757168475996160 to 7316757168436682752. Current Snapshot: MvccSnapshot[applied={T|T < 7316757168475996160}]
I20260809 23:21:08.096159 15072 mvcc.cc:205] Tried to move back new op lower bound from 7316757168475996160 to 7316757168436682752. Current Snapshot: MvccSnapshot[applied={T|T < 7316757168475996160}]
I20260809 23:21:08.098161 14512 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:21:08.098237 14512 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:21:08.099258 14512 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5001c4cfab7c4c56b4c3ef91d726b347: Sending DeleteTablet for 3 replicas of tablet 6d6b29e000f74d79b05bf45e28d68167
I20260809 23:21:08.099660 14672 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d6b29e000f74d79b05bf45e28d68167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:21:08 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:59694
I20260809 23:21:08.099653 14813 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d6b29e000f74d79b05bf45e28d68167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:21:08 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:38962
I20260809 23:21:08.099920 14950 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d6b29e000f74d79b05bf45e28d68167 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:21:08 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:49668
I20260809 23:21:08.100731 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 14601
I20260809 23:21:08.109905 15082 tablet_replica.cc:330] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9: stopping tablet replica
I20260809 23:21:08.110014 15082 raft_consensus.cc:2229] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:21:08.110114 15082 raft_consensus.cc:2258] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:21:08.112111 15082 ts_tablet_manager.cc:1905] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:21:08.114395 15081 tablet_replica.cc:330] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851: stopping tablet replica
I20260809 23:21:08.114503 15081 raft_consensus.cc:2229] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:21:08.114603 15081 raft_consensus.cc:2258] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 23:21:08.114820 14497 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.235.129:39937 (error 108)
I20260809 23:21:08.115096 15081 ts_tablet_manager.cc:1905] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:21:08.116653 15081 ts_tablet_manager.cc:1918] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:21:08.116724 15081 log.cc:1196] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/6d6b29e000f74d79b05bf45e28d68167
I20260809 23:21:08.116878 15082 ts_tablet_manager.cc:1918] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:21:08.117000 15082 log.cc:1196] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/6d6b29e000f74d79b05bf45e28d68167
I20260809 23:21:08.117275 15081 ts_tablet_manager.cc:1939] T 6d6b29e000f74d79b05bf45e28d68167 P c31aca6be61a48b59a2890920038a851: Deleting consensus metadata
I20260809 23:21:08.117395 15082 ts_tablet_manager.cc:1939] T 6d6b29e000f74d79b05bf45e28d68167 P aed3658682e342cc81369f5e78aa53c9: Deleting consensus metadata
I20260809 23:21:08.117686 14499 catalog_manager.cc:4841] TS c31aca6be61a48b59a2890920038a851 (127.1.235.130:41787): tablet 6d6b29e000f74d79b05bf45e28d68167 (table test-table [id=9e2c8e2025fe4e4faf8690054e67e7d8]) successfully deleted
I20260809 23:21:08.117877 14497 catalog_manager.cc:4841] TS aed3658682e342cc81369f5e78aa53c9 (127.1.235.131:41449): tablet 6d6b29e000f74d79b05bf45e28d68167 (table test-table [id=9e2c8e2025fe4e4faf8690054e67e7d8]) successfully deleted
I20260809 23:21:08.125929 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 14750
Aug 09 23:21:08 dist-test-slave-6nmv krb5kdc[13997](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317667, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
I20260809 23:21:08.138074 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 14898
I20260809 23:21:08.152603 15051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:08.146121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:39937 (local address 127.0.0.1:59710)
0809 23:21:08.152502 (+ 6381us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:08.152561 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.129:39937: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6355}
W20260809 23:21:08.152822 14497 catalog_manager.cc:4584] TS 9bb34f048de14e03bc95b286ea8f0c08 (127.1.235.129:39937): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6d6b29e000f74d79b05bf45e28d68167: Network error: Client connection negotiation failed: client connection to 127.1.235.129:39937: connect: Connection refused (error 111)
I20260809 23:21:08.156044 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 14479
I20260809 23:21:08.168299 1966 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 23:21:08.514376 1966 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 23:21:08.514508 1966 mini_ranger.cc:66] Stopping Ranger...
I20260809 23:21:08.859269 1966 mini_ranger.cc:68] Stopped Ranger
2026-08-09 23:21:08.859 UTC [14031] LOG: received smart shutdown request
2026-08-09 23:21:08.863 UTC [14031] LOG: background worker "logical replication launcher" (PID 14041) exited with exit code 1
2026-08-09 23:21:08.863 UTC [14035] LOG: shutting down
2026-08-09 23:21:09.049 UTC [14031] LOG: database system is shut down
2026-08-09T23:21:09Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (46146 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:21:09 dist-test-slave-6nmv krb5kdc[15093](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:21:09 dist-test-slave-6nmv krb5kdc[15093](info): set up 2 sockets
Aug 09 23:21:09 dist-test-slave-6nmv krb5kdc[15093](info): commencing operation
krb5kdc: starting...
W20260809 23:21:10.175791 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.004s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:21:10 dist-test-slave-6nmv krb5kdc[15093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317670, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:21:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:21:10Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.1.235.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.1.235.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.1.235.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/rangeradmin_127.1.235.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.1.235.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/rangeradmin_127.1.235.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.1.235.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.1.235.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.1.235.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/rangerlookup_127.1.235.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.1.235.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/rangerlookup_127.1.235.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.235.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.1.235.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.235.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/HTTP_127.1.235.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.235.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/HTTP_127.1.235.148@KRBTEST.COM.keytab.
I20260809 23:21:10.327977 1966 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskGyHluD/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/postgres -l logfile start
2026-08-09 23:21:12.848 UTC [15124] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 23:21:12.848 UTC [15124] LOG: listening on IPv4 address "127.1.235.148", port 38345
2026-08-09 23:21:12.852 UTC [15124] LOG: listening on Unix socket "/tmp/.s.PGSQL.38345"
2026-08-09 23:21:12.885 UTC [15127] LOG: database system was shut down at 2026-08-09 23:21:11 UTC
2026-08-09 23:21:12.890 UTC [15124] LOG: database system is ready to accept connections
I20260809 23:21:13.838137 1966 mini_postgres.cc:96] Postgres bound to 38345
2026-08-09 23:21:13.845 UTC [15135] FATAL: database "slave" does not exist
127.1.235.148:38345 - accepting connections
I20260809 23:21:13.845589 1966 mini_ranger.cc:161] Starting Ranger...
I20260809 23:21:13.860368 1966 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 23:21:14.361176 1966 mini_ranger.cc:87] Created ranger Postgres database
I20260809 23:21:14.361269 1966 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-admin
2026-08-09 23:21:14,600 [I] DB FLAVOR :POSTGRES
2026-08-09 23:21:14,601 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 23:21:14,601 [I] Checking connection..
2026-08-09 23:21:14,601 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 23:21:14,825 [I] Checking connection passed.
2026-08-09 23:21:14,825 [I] --------- Verifying version history table ---------
2026-08-09 23:21:14,825 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 23:21:15,058 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 23:21:15,059 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 23:21:15,297 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 23:21:15,297 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 23:21:15,297 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 23:21:15.524 UTC [15208] WARNING: there is no transaction in progress
2026-08-09 23:21:15,531 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 23:21:15,532 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 23:21:15,778 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 23:21:15,778 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 23:21:15,779 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 23:21:16,020 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 23:21:16,259 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-6nmv.c.gcp-upstream.internal','N') ;"
2026-08-09 23:21:16,496 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 23:21:16,738 [I] Table x_portal_user does not exist in database ranger
2026-08-09 23:21:16,739 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 23:21:16,976 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 23:21:16,977 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 23:21:17,198 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 23:21:17,448 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 23:21:17,449 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 23:21:18.363 UTC [15320] WARNING: there is no transaction in progress
2026-08-09 23:21:18.377 UTC [15320] WARNING: there is no transaction in progress
2026-08-09 23:21:18.392 UTC [15320] WARNING: there is no transaction in progress
2026-08-09 23:21:18.406 UTC [15320] WARNING: there is no transaction in progress
2026-08-09 23:21:18.420 UTC [15320] WARNING: there is no transaction in progress
2026-08-09 23:21:18.436 UTC [15320] WARNING: there is no transaction in progress
2026-08-09 23:21:18.489 UTC [15320] WARNING: there is no transaction in progress
2026-08-09 23:21:18.496 UTC [15320] WARNING: there is no transaction in progress
2026-08-09 23:21:18.509 UTC [15320] WARNING: there is no transaction in progress
2026-08-09 23:21:18.519 UTC [15320] WARNING: there is no transaction in progress
2026-08-09 23:21:18.527 UTC [15320] WARNING: there is no transaction in progress
2026-08-09 23:21:18.540 UTC [15320] WARNING: there is no transaction in progress
2026-08-09 23:21:18.548 UTC [15320] WARNING: there is no transaction in progress
2026-08-09 23:21:18.554 UTC [15320] WARNING: there is no transaction in progress
2026-08-09 23:21:18.560 UTC [15320] WARNING: there is no transaction in progress
2026-08-09 23:21:18.567 UTC [15320] WARNING: there is no transaction in progress
2026-08-09 23:21:19,190 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 23:21:19,190 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 23:21:19,430 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 23:21:19,430 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 23:21:19,673 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 23:21:19,674 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 23:21:19,912 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 23:21:19,913 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 23:21:20,162 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 23:21:20,406 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-6nmv.c.gcp-upstream.internal';"
2026-08-09 23:21:20,635 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 23:21:20,635 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 23:21:20,881 [I] DB_PATCHES have already been applied
I20260809 23:21:20.886698 1966 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-admin:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskGyHluD/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 23:21:20.886801 1966 mini_ranger.cc:193] Using host: 127.1.235.148
I20260809 23:21:20.890655 1966 mini_ranger.cc:227] Ranger admin URL: http://127.1.235.148:32847
Aug 09, 2026 11:21:21 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 11:21:21 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 11:21:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 11:21:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 11:21:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 11:21:21 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 11:21:21 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 23:21:22.034886 1966 mini_ranger.cc:160] Time spent starting Ranger: real 8.189s user 0.000s sys 0.009s
Aug 09, 2026 11:21:41 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 11:21:42 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 11:21:42 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 11:21:42 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 11:21:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 11:21:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 11:21:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 11:21:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 11:21:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 11:21:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 11:21:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 11:21:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 11:21:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 11:21:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 11:21:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 11:21:42 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 11:21:42 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 11:21:42 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 23:21:43.441498 1966 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.1.235.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.1.235.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.1.235.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/rangerkms_127.1.235.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.1.235.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/rangerkms_127.1.235.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.1.235.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.1.235.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.1.235.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/HTTP_127.1.235.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.1.235.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/HTTP_127.1.235.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 23:21:43 dist-test-slave-6nmv krb5kdc[15093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317703, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 23:21:43.516583 1966 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 23:21:43.525414 1966 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 23:21:44.329317 1966 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 23:21:44.329429 1966 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-kms
I20260809 23:21:44.329452 1966 mini_ranger_kms.cc:227] Using postgres at 127.1.235.148:38345
2026-08-09 23:21:44,503 [I] DB FLAVOR :POSTGRES
2026-08-09 23:21:44,503 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 23:21:44,503 [I] Checking connection
2026-08-09 23:21:44,503 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 23:21:44,770 [I] connection success
2026-08-09 23:21:44,770 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 23:21:44,770 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 23:21:44,770 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 23:21:45,044 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 23:21:45,044 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 23:21:45,044 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 23:21:45,044 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.1.235.148:38345/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 23:21:45,344 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 23:21:45.782459 1966 mini_ranger_kms.cc:310] Created kms service
I20260809 23:21:45.992333 1966 mini_ranger_kms.cc:326] Created kudu user
I20260809 23:21:46.036059 1966 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 23:21:46 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317703, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
I20260809 23:21:46.442155 1966 mini_ranger_kms.cc:384] Added ranger policy
I20260809 23:21:46.442265 1966 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-kms:/tmp/dist-test-taskGyHluD/build/release/bin/postgresql.jar:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskGyHluD/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 23:21:46.442282 1966 mini_ranger_kms.cc:240] Using host: 127.1.235.148
I20260809 23:21:46.446173 1966 mini_ranger_kms.cc:276] Ranger KMS PID: 15518
I20260809 23:21:46.446245 1966 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.1.235.148:54081
Aug 09, 2026 11:21:47 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 11:21:47 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 11:21:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 11:21:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 11:21:48 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 11:21:48 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260809 23:21:48.746682 1966 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.230s user 0.004s sys 0.152s
I20260809 23:21:48.746788 1966 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 23:21:48.746832 1966 mini_ranger_kms.cc:401] 127.1.235.148:54081/kms/v1/keys
Aug 09 23:21:48 dist-test-slave-6nmv krb5kdc[15093](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786317708, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.235.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 09 23:21:49 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317708, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.235.148@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
Aug 09 23:21:49 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317708, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.1.235.148@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
Aug 09 23:21:51 dist-test-slave-6nmv krb5kdc[15093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:21:51.832581 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:39993
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:39993
--ranger_config_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.235.148:54081/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:21:51.920321 15573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:21:51.920495 15573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:21:51.920514 15573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:21:51.921548 15573 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:21:51.921586 15573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:21:51.921598 15573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:21:51.921649 15573 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:21:51.921674 15573 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:21:51.923138 15573 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/wal
--ranger_kms_url=127.1.235.148:54081/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:39993
--ranger_config_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:39993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15573
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:21:51.923295 15573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:21:51.923518 15573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:21:51.928018 15579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:51.928041 15581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:51.928084 15578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:51.928128 15573 server_base.cc:1034] running on GCE node
I20260809 23:21:51.928388 15573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:21:51.928633 15573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:21:51.929757 15573 hybrid_clock.cc:648] HybridClock initialized: now 1786317711929752 us; error 32 us; skew 500 ppm
Aug 09 23:21:51 dist-test-slave-6nmv krb5kdc[15093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317711, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:21:51.937505 15573 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:21:51.937964 15573 webserver.cc:460] Webserver started at http://127.1.235.190:33377/ using document root <none> and password file <none>
I20260809 23:21:51.938189 15573 fs_manager.cc:359] Metadata directory not provided
I20260809 23:21:51.938241 15573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:21:51.938403 15573 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 23:21:51 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317711, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
I20260809 23:21:51.986807 15573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "e781ea3740e841eeba9850ba7073f668"
format_stamp: "Formatted at 2026-08-09 23:21:51 on dist-test-slave-6nmv"
server_key: "eea27ca43b718e883537e033d6095d57"
server_key_iv: "1162d01cde2da8e7ae2b253edd45bc40"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:51.987237 15573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "e781ea3740e841eeba9850ba7073f668"
format_stamp: "Formatted at 2026-08-09 23:21:51 on dist-test-slave-6nmv"
server_key: "eea27ca43b718e883537e033d6095d57"
server_key_iv: "1162d01cde2da8e7ae2b253edd45bc40"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:51.988720 15573 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 23:21:52.000109 15589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:52.000286 15573 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:21:52.000371 15573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "e781ea3740e841eeba9850ba7073f668"
format_stamp: "Formatted at 2026-08-09 23:21:51 on dist-test-slave-6nmv"
server_key: "eea27ca43b718e883537e033d6095d57"
server_key_iv: "1162d01cde2da8e7ae2b253edd45bc40"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:52.000444 15573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:21:52.027799 15573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:21:52.030117 15573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:21:52.030275 15573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:21:52.035719 15573 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:39993
I20260809 23:21:52.035746 15645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:39993 every 8 connection(s)
I20260809 23:21:52.036425 15573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:21:52.037228 15646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:21:52.038498 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 15573
I20260809 23:21:52.038728 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:21:52.039140 1966 external_mini_cluster.cc:1428] Setting key c488568e115ba4a21f1dca19fc23777d
I20260809 23:21:52.040653 15646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668: Bootstrap starting.
I20260809 23:21:52.041379 15646 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668: Neither blocks nor log segments found. Creating new log.
I20260809 23:21:52.041736 15646 log.cc:824] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668: Log is configured to *not* fsync() on all Append() calls
I20260809 23:21:52.042587 15646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668: No bootstrap required, opened a new log
I20260809 23:21:52.045075 15646 raft_consensus.cc:348] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e781ea3740e841eeba9850ba7073f668" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39993 } }
I20260809 23:21:52.045246 15646 raft_consensus.cc:374] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:21:52.045291 15646 raft_consensus.cc:729] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e781ea3740e841eeba9850ba7073f668, State: Initialized, Role: FOLLOWER
I20260809 23:21:52.045459 15646 consensus_queue.cc:260] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e781ea3740e841eeba9850ba7073f668" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39993 } }
I20260809 23:21:52.045559 15646 raft_consensus.cc:388] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:21:52.045599 15646 raft_consensus.cc:482] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:21:52.045639 15646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:21:52.046307 15646 raft_consensus.cc:504] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e781ea3740e841eeba9850ba7073f668" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39993 } }
I20260809 23:21:52.046432 15646 leader_election.cc:302] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e781ea3740e841eeba9850ba7073f668; no voters:
I20260809 23:21:52.046588 15646 leader_election.cc:288] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:21:52.046634 15652 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:21:52.046789 15652 raft_consensus.cc:686] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [term 1 LEADER]: Becoming Leader. State: Replica: e781ea3740e841eeba9850ba7073f668, State: Running, Role: LEADER
I20260809 23:21:52.046859 15646 sys_catalog.cc:564] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:21:52.046869 15652 consensus_queue.cc:237] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e781ea3740e841eeba9850ba7073f668" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39993 } }
I20260809 23:21:52.047196 15652 sys_catalog.cc:455] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e781ea3740e841eeba9850ba7073f668" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e781ea3740e841eeba9850ba7073f668" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39993 } } }
I20260809 23:21:52.047267 15652 sys_catalog.cc:458] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [sys.catalog]: This master's current role is: LEADER
I20260809 23:21:52.047399 15652 sys_catalog.cc:455] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e781ea3740e841eeba9850ba7073f668. Latest consensus state: current_term: 1 leader_uuid: "e781ea3740e841eeba9850ba7073f668" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e781ea3740e841eeba9850ba7073f668" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39993 } } }
I20260809 23:21:52.047444 15652 sys_catalog.cc:458] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [sys.catalog]: This master's current role is: LEADER
I20260809 23:21:52.048497 15646 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 09 23:21:52 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:21:52.054661 15657 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:21:52.055244 15657 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:21:52.055474 15649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:52.039984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37592 (local address 127.1.235.190:39993)
0809 23:21:52.040198 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:52.040207 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:52.040270 (+ 63us) server_negotiation.cc:407] Connection header received
0809 23:21:52.041131 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:52.041164 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:52.041251 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:52.042567 (+ 1316us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:52.042743 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:52.044212 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:52.045494 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:52.046311 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:52.050873 (+ 4562us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:52.051391 (+ 518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:52.051395 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:52.051395 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:52.051405 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:52.053762 (+ 2357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:52.054141 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:52.054144 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:52.054144 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:52.054225 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:52.054446 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:52.054447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:52.054448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:52.054793 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:52.054957 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:52.055052 (+ 95us) server_negotiation.cc:299] Negotiation successful
0809 23:21:52.055205 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":90,"threads_started":1}
I20260809 23:21:52.065917 15657 catalog_manager.cc:1347] Generated new cluster ID: 08ea715be59e4b37ac05a1e0b3e1de44
I20260809 23:21:52.065982 15657 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:21:52.087378 15657 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:21:52.088121 15657 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:21:52.097115 15657 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668: Generated new TSK 0
I20260809 23:21:52.097285 15657 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:21:52.710988 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.235.148:54081/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39993
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:21:52.791878 15694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:21:52.792105 15694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:21:52.792145 15694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:21:52.793262 15694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:21:52.793327 15694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:21:52.793372 15694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:21:52.794847 15694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.1.235.148:54081/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:21:52.795115 15694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:21:52.795336 15694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:21:52.800284 15703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:52.800319 15700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:52.800506 15701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:52.800755 15694 server_base.cc:1034] running on GCE node
I20260809 23:21:52.800966 15694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:21:52.801205 15694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:21:52.802359 15694 hybrid_clock.cc:648] HybridClock initialized: now 1786317712802345 us; error 31 us; skew 500 ppm
Aug 09 23:21:52 dist-test-slave-6nmv krb5kdc[15093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317712, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:21:52.805277 15694 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:21:52.805788 15694 webserver.cc:460] Webserver started at http://127.1.235.129:37845/ using document root <none> and password file <none>
I20260809 23:21:52.806079 15694 fs_manager.cc:359] Metadata directory not provided
I20260809 23:21:52.806150 15694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:21:52.806284 15694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 23:21:52 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317712, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
I20260809 23:21:52.828173 15694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "104ce5f0e9aa41cf81bdb98f7440744a"
format_stamp: "Formatted at 2026-08-09 23:21:52 on dist-test-slave-6nmv"
server_key: "218f9d28035b2e633aaebfef31af9446"
server_key_iv: "008673c9751d7a3a705ba7ce1456cb73"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:52.828670 15694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "104ce5f0e9aa41cf81bdb98f7440744a"
format_stamp: "Formatted at 2026-08-09 23:21:52 on dist-test-slave-6nmv"
server_key: "218f9d28035b2e633aaebfef31af9446"
server_key_iv: "008673c9751d7a3a705ba7ce1456cb73"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:52.835654 15694 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.000s sys 0.001s
I20260809 23:21:52.848505 15712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:52.848661 15694 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 23:21:52.848742 15694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "104ce5f0e9aa41cf81bdb98f7440744a"
format_stamp: "Formatted at 2026-08-09 23:21:52 on dist-test-slave-6nmv"
server_key: "218f9d28035b2e633aaebfef31af9446"
server_key_iv: "008673c9751d7a3a705ba7ce1456cb73"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:52.848817 15694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:21:52.877389 15694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:21:52.880085 15694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:21:52.880299 15694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:21:52.880537 15694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:21:52.880913 15694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:21:52.880983 15694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:52.881016 15694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:21:52.881034 15694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:52.888388 15694 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:43339
I20260809 23:21:52.888520 15836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:43339 every 8 connection(s)
I20260809 23:21:52.888816 15694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:21:52.889892 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 15694
I20260809 23:21:52.889991 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:21:52.890197 1966 external_mini_cluster.cc:1428] Setting key 0ba5b70229710449108495c51b85be6c
Aug 09 23:21:52 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317712, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:21:52.901436 15839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:52.889544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:47183 (local address 127.1.235.190:39993)
0809 23:21:52.889908 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:52.889910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:52.889919 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:21:52.890554 (+ 635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:52.890556 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:52.890569 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:52.890657 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:52.891193 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:52.891680 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:52.895291 (+ 3611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:52.895639 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:52.895684 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:52.898172 (+ 2488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:52.898173 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:52.898173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:52.898180 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:52.899847 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:52.900325 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:52.900327 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:52.900327 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:52.900393 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:52.900697 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:52.900698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:52.900698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:52.900830 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:52.900898 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:52.901249 (+ 351us) server_negotiation.cc:299] Negotiation successful
0809 23:21:52.901332 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":90,"threads_started":1}
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
I20260809 23:21:52.901542 15840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:52.889538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39993 (local address 127.1.235.129:47183)
0809 23:21:52.889693 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:52.889736 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:52.890327 (+ 591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:52.890716 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:52.890720 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:52.890900 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:52.891101 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:52.891105 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:52.893922 (+ 2817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:52.893924 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:52.895178 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:52.895181 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:52.895809 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:52.895810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:52.895933 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:52.896477 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:52.896486 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:52.898051 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:52.899949 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:52.899956 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:52.899958 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:52.900229 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:52.900476 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:52.900477 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:52.900477 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:52.900610 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:52.900917 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:52.900924 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:52.901080 (+ 156us) client_negotiation.cc:769] Sending connection context
0809 23:21:52.901190 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 23:21:52.901329 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":81,"threads_started":1}
I20260809 23:21:52.901999 15837 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39993
I20260809 23:21:52.902093 15837 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:52.902258 15837 heartbeater.cc:511] Master 127.1.235.190:39993 requested a full tablet report, sending...
I20260809 23:21:52.902724 15606 ts_manager.cc:194] Registered new tserver with Master: 104ce5f0e9aa41cf81bdb98f7440744a (127.1.235.129:43339)
I20260809 23:21:52.903532 15606 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:47183
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:21:52.922215 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.235.148:54081/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39993
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:21:53.023066 15843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:21:53.023273 15843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:21:53.023324 15843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:21:53.024529 15843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:21:53.024616 15843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:21:53.024662 15843 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:21:53.026439 15843 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.1.235.148:54081/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:21:53.026659 15843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:21:53.026849 15843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:21:53.031379 15854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:53.031467 15852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:53.031507 15851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:53.031899 15843 server_base.cc:1034] running on GCE node
I20260809 23:21:53.032228 15843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:21:53.032507 15843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:21:53.033660 15843 hybrid_clock.cc:648] HybridClock initialized: now 1786317713033643 us; error 32 us; skew 500 ppm
Aug 09 23:21:53 dist-test-slave-6nmv krb5kdc[15093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317713, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:21:53.036469 15843 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:21:53.036917 15843 webserver.cc:460] Webserver started at http://127.1.235.130:33705/ using document root <none> and password file <none>
I20260809 23:21:53.037140 15843 fs_manager.cc:359] Metadata directory not provided
I20260809 23:21:53.037189 15843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:21:53.037319 15843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 23:21:53 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317713, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
Aug 09 23:21:53 dist-test-slave-6nmv krb5kdc[15093](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786317713, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:21:53.049602 15843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "797adaa68cfe41f1a08361b5468943e5"
format_stamp: "Formatted at 2026-08-09 23:21:53 on dist-test-slave-6nmv"
server_key: "2d50f6a92f4435032cd0e4bc9d980556"
server_key_iv: "a262776c0b3bc20ac473b35938cc2d4d"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:53.050108 15843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "797adaa68cfe41f1a08361b5468943e5"
format_stamp: "Formatted at 2026-08-09 23:21:53 on dist-test-slave-6nmv"
server_key: "2d50f6a92f4435032cd0e4bc9d980556"
server_key_iv: "a262776c0b3bc20ac473b35938cc2d4d"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:53.051923 15843 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:21:53.080546 15863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:53.080807 15843 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260809 23:21:53.080899 15843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "797adaa68cfe41f1a08361b5468943e5"
format_stamp: "Formatted at 2026-08-09 23:21:53 on dist-test-slave-6nmv"
server_key: "2d50f6a92f4435032cd0e4bc9d980556"
server_key_iv: "a262776c0b3bc20ac473b35938cc2d4d"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:53.080999 15843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:21:53.107613 15843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:21:53.111233 15843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:21:53.111383 15843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:21:53.111604 15843 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:21:53.111986 15843 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:21:53.112044 15843 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:53.112078 15843 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:21:53.112144 15843 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:53.118645 15843 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:43489
I20260809 23:21:53.118943 15984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:43489 every 8 connection(s)
I20260809 23:21:53.119140 15843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:21:53.119454 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 15843
I20260809 23:21:53.119549 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:21:53.119761 1966 external_mini_cluster.cc:1428] Setting key 077adc83056e1f2906face96b7b22f7c
Aug 09 23:21:53 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317713, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:21:53.131078 15839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:53.120743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:39445 (local address 127.1.235.190:39993)
0809 23:21:53.120811 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:53.120813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:53.121060 (+ 247us) server_negotiation.cc:407] Connection header received
0809 23:21:53.121736 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:53.121737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:53.121752 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:53.121781 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:53.122584 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:53.123294 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:53.124806 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:53.125118 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:53.125165 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:53.127907 (+ 2742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:53.127909 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:53.127909 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:53.127916 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:53.129559 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:53.130055 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:53.130057 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:53.130057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:53.130119 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:53.130386 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:53.130387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:53.130387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:53.130523 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:53.130577 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:53.130902 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 23:21:53.130994 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260809 23:21:53.131834 15987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:53.120159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39993 (local address 127.1.235.130:39445)
0809 23:21:53.120936 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:53.120984 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:53.121619 (+ 635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:53.121971 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:53.121975 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:53.122194 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:53.122460 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:53.122466 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:53.123407 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:53.123407 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:53.124704 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:53.124707 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:53.125257 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:53.125257 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:53.125413 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:53.126195 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:53.126205 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:53.127801 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:53.129650 (+ 1849us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:53.129656 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:53.129658 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:53.129959 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:53.130192 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:53.130193 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:53.130193 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:53.130312 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:53.130610 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:53.130616 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:53.130756 (+ 140us) client_negotiation.cc:769] Sending connection context
0809 23:21:53.131407 (+ 651us) client_negotiation.cc:240] Negotiation successful
0809 23:21:53.131558 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"thread_start_us":83,"threads_started":1}
I20260809 23:21:53.132469 15985 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39993
I20260809 23:21:53.132555 15985 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:53.132731 15985 heartbeater.cc:511] Master 127.1.235.190:39993 requested a full tablet report, sending...
I20260809 23:21:53.133117 15606 ts_manager.cc:194] Registered new tserver with Master: 797adaa68cfe41f1a08361b5468943e5 (127.1.235.130:43489)
I20260809 23:21:53.133559 15606 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:39445
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:21:53.160807 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.235.148:54081/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39993
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:21:53.275696 15990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:21:53.276036 15990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:21:53.276120 15990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:21:53.277675 15990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:21:53.277776 15990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:21:53.277886 15990 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:21:53.279958 15990 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.1.235.148:54081/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:21:53.280465 15990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:21:53.280761 15990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:21:53.288674 15997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:53.288693 15996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:53.289212 15999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:53.289695 15990 server_base.cc:1034] running on GCE node
I20260809 23:21:53.289893 15990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:21:53.290124 15990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:21:53.291293 15990 hybrid_clock.cc:648] HybridClock initialized: now 1786317713291272 us; error 48 us; skew 500 ppm
Aug 09 23:21:53 dist-test-slave-6nmv krb5kdc[15093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317713, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:21:53.294406 15990 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:21:53.294898 15990 webserver.cc:460] Webserver started at http://127.1.235.131:44147/ using document root <none> and password file <none>
I20260809 23:21:53.295159 15990 fs_manager.cc:359] Metadata directory not provided
I20260809 23:21:53.295217 15990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:21:53.295343 15990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 23:21:53 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317713, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
I20260809 23:21:53.313930 15990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "5dc0baa511aa413487b4c056e8f43250"
format_stamp: "Formatted at 2026-08-09 23:21:53 on dist-test-slave-6nmv"
server_key: "f43ecde8aeb1e2f6a83110f3b8e61e1c"
server_key_iv: "7746835404097cb9182bf75cb1f0a1b8"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:53.314318 15990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "5dc0baa511aa413487b4c056e8f43250"
format_stamp: "Formatted at 2026-08-09 23:21:53 on dist-test-slave-6nmv"
server_key: "f43ecde8aeb1e2f6a83110f3b8e61e1c"
server_key_iv: "7746835404097cb9182bf75cb1f0a1b8"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:53.316992 15990 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 23:21:53.339912 16007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:53.340081 15990 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.001s
I20260809 23:21:53.340169 15990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "5dc0baa511aa413487b4c056e8f43250"
format_stamp: "Formatted at 2026-08-09 23:21:53 on dist-test-slave-6nmv"
server_key: "f43ecde8aeb1e2f6a83110f3b8e61e1c"
server_key_iv: "7746835404097cb9182bf75cb1f0a1b8"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:53.340247 15990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:21:53.357228 15990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:21:53.359344 15990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:21:53.359490 15990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:21:53.359721 15990 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:21:53.360059 15990 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:21:53.360103 15990 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:53.360137 15990 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:21:53.360159 15990 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:53.376215 15990 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:44559
I20260809 23:21:53.376619 15990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:21:53.379020 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 15990
I20260809 23:21:53.379127 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:21:53.379328 1966 external_mini_cluster.cc:1428] Setting key de14e7c2849bc8dc821b3ad992cc3436
Aug 09 23:21:53 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317713, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:21:53.389703 15839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:53.378672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:35831 (local address 127.1.235.190:39993)
0809 23:21:53.378742 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:53.378745 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:53.379060 (+ 315us) server_negotiation.cc:407] Connection header received
0809 23:21:53.380146 (+ 1086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:53.380147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:53.380159 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:53.380189 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:53.381190 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:53.381981 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:53.383414 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:53.383695 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:53.383739 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:53.386442 (+ 2703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:53.386443 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:53.386444 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:53.386450 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:53.388114 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:53.388608 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:53.388609 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:53.388609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:53.388668 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:53.388967 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:53.388968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:53.388969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:53.389102 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:53.389148 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:53.389522 (+ 374us) server_negotiation.cc:299] Negotiation successful
0809 23:21:53.389609 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 23:21:53.377732 16128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:44559 every 8 connection(s)
I20260809 23:21:53.390307 16131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:53.378321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39993 (local address 127.1.235.131:35831)
0809 23:21:53.378917 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:53.378968 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:53.380026 (+ 1058us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:53.380506 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:53.380511 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:53.380735 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:53.381037 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:53.381043 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:53.382095 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:53.382095 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:53.383307 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:53.383310 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:53.383841 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:53.383842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:53.383992 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:53.384599 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:53.384608 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:53.386341 (+ 1733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:53.388202 (+ 1861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:53.388207 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:53.388209 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:53.388495 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:53.388742 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:53.388743 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:53.388743 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:53.388868 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:53.389199 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:53.389206 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:53.389358 (+ 152us) client_negotiation.cc:769] Sending connection context
0809 23:21:53.389876 (+ 518us) client_negotiation.cc:240] Negotiation successful
0809 23:21:53.390092 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":158,"threads_started":1}
I20260809 23:21:53.391252 16129 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39993
I20260809 23:21:53.391346 16129 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:53.391525 16129 heartbeater.cc:511] Master 127.1.235.190:39993 requested a full tablet report, sending...
I20260809 23:21:53.391927 15606 ts_manager.cc:194] Registered new tserver with Master: 5dc0baa511aa413487b4c056e8f43250 (127.1.235.131:44559)
I20260809 23:21:53.392424 15606 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:35831
I20260809 23:21:53.401767 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:21:53.402459 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 15694
I20260809 23:21:53.430351 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 15843
I20260809 23:21:53.437695 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 15990
I20260809 23:21:53.452711 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 15573
I20260809 23:21:53.466048 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:39993
--webserver_interface=127.1.235.190
--webserver_port=33377
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:39993
--ranger_config_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.235.148:54081/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.235.148:54081/kms with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:21:53.564901 16132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:21:53.565099 16132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:21:53.565124 16132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:21:53.566277 16132 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:21:53.566318 16132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:21:53.566334 16132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:21:53.566346 16132 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:21:53.566358 16132 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:21:53.567866 16132 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.235.148:54081/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:39993
--ranger_config_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:39993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=33377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:21:53.568099 16132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:21:53.568342 16132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:21:53.574369 16141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:53.574333 16139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:53.574347 16138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:53.574767 16132 server_base.cc:1034] running on GCE node
I20260809 23:21:53.575053 16132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:21:53.575361 16132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:21:53.576581 16132 hybrid_clock.cc:648] HybridClock initialized: now 1786317713576562 us; error 32 us; skew 500 ppm
Aug 09 23:21:53 dist-test-slave-6nmv krb5kdc[15093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317713, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:21:53.579254 16132 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:21:53.579733 16132 webserver.cc:460] Webserver started at http://127.1.235.190:33377/ using document root <none> and password file <none>
I20260809 23:21:53.579941 16132 fs_manager.cc:359] Metadata directory not provided
I20260809 23:21:53.580024 16132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 23:21:53 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317713, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
I20260809 23:21:53.656543 16132 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:21:53.657255 16151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:53.657413 16132 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:21:53.657533 16132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "e781ea3740e841eeba9850ba7073f668"
format_stamp: "Formatted at 2026-08-09 23:21:51 on dist-test-slave-6nmv"
server_key: "eea27ca43b718e883537e033d6095d57"
server_key_iv: "1162d01cde2da8e7ae2b253edd45bc40"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:53.657996 16132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:21:53.676930 16132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:21:53.678949 16132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:21:53.679064 16132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:21:53.683068 16132 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:39993
I20260809 23:21:53.683110 16207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:39993 every 8 connection(s)
I20260809 23:21:53.683435 16132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:21:53.684506 16208 sys_catalog.cc:263] Verifying existing consensus state
I20260809 23:21:53.685184 16208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668: Bootstrap starting.
I20260809 23:21:53.693046 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 16132
I20260809 23:21:53.693331 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.235.148:54081/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:43339
--local_ip_for_outbound_sockets=127.1.235.129
--tserver_master_addrs=127.1.235.190:39993
--webserver_port=37845
--webserver_interface=127.1.235.129
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.235.148:54081/kms with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:21:53.693610 16208 log.cc:824] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668: Log is configured to *not* fsync() on all Append() calls
I20260809 23:21:53.695586 16208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 23:21:53.695910 16208 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668: Bootstrap complete.
I20260809 23:21:53.699903 16208 raft_consensus.cc:348] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e781ea3740e841eeba9850ba7073f668" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39993 } }
I20260809 23:21:53.700285 16208 raft_consensus.cc:729] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e781ea3740e841eeba9850ba7073f668, State: Initialized, Role: FOLLOWER
I20260809 23:21:53.700470 16208 consensus_queue.cc:260] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e781ea3740e841eeba9850ba7073f668" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39993 } }
I20260809 23:21:53.700554 16208 raft_consensus.cc:388] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:21:53.700599 16208 raft_consensus.cc:482] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:21:53.700654 16208 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [term 1 FOLLOWER]: Advancing to term 2
I20260809 23:21:53.702224 16208 raft_consensus.cc:504] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e781ea3740e841eeba9850ba7073f668" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39993 } }
I20260809 23:21:53.702349 16208 leader_election.cc:302] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e781ea3740e841eeba9850ba7073f668; no voters:
I20260809 23:21:53.702539 16208 leader_election.cc:288] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 23:21:53.702628 16212 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 23:21:53.702809 16208 sys_catalog.cc:564] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:21:53.702823 16212 raft_consensus.cc:686] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [term 2 LEADER]: Becoming Leader. State: Replica: e781ea3740e841eeba9850ba7073f668, State: Running, Role: LEADER
I20260809 23:21:53.703038 16212 consensus_queue.cc:237] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e781ea3740e841eeba9850ba7073f668" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39993 } }
I20260809 23:21:53.703352 16215 sys_catalog.cc:455] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e781ea3740e841eeba9850ba7073f668. Latest consensus state: current_term: 2 leader_uuid: "e781ea3740e841eeba9850ba7073f668" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e781ea3740e841eeba9850ba7073f668" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39993 } } }
I20260809 23:21:53.703446 16215 sys_catalog.cc:458] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [sys.catalog]: This master's current role is: LEADER
I20260809 23:21:53.703580 16214 sys_catalog.cc:455] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e781ea3740e841eeba9850ba7073f668" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e781ea3740e841eeba9850ba7073f668" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39993 } } }
I20260809 23:21:53.703644 16214 sys_catalog.cc:458] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668 [sys.catalog]: This master's current role is: LEADER
I20260809 23:21:53.703714 16222 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:21:53.704188 16222 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:21:53.704313 16222 catalog_manager.cc:1259] Loaded cluster ID: 08ea715be59e4b37ac05a1e0b3e1de44
I20260809 23:21:53.704355 16222 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:21:53.704596 16208 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 23:21:53.708607 16222 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:21:53.708993 16222 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668: Loaded TSK: 0
I20260809 23:21:53.709221 16222 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 23:21:53.783077 16211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:21:53.783387 16211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:21:53.783442 16211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:21:53.786093 16211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:21:53.786151 16211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:21:53.786198 16211 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:21:53.788434 16211 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.235.148:54081/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:43339
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=37845
--tserver_master_addrs=127.1.235.190:39993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16211
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:21:53.788655 16211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:21:53.788919 16211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:21:53.795441 16249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:53.795454 16248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:53.795821 16211 server_base.cc:1034] running on GCE node
W20260809 23:21:53.795924 16251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:53.796139 16211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:21:53.796362 16211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:21:53.797526 16211 hybrid_clock.cc:648] HybridClock initialized: now 1786317713797501 us; error 38 us; skew 500 ppm
Aug 09 23:21:53 dist-test-slave-6nmv krb5kdc[15093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317713, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:21:53.800386 16211 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:21:53.800846 16211 webserver.cc:460] Webserver started at http://127.1.235.129:37845/ using document root <none> and password file <none>
I20260809 23:21:53.801092 16211 fs_manager.cc:359] Metadata directory not provided
I20260809 23:21:53.801158 16211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 23:21:53 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317713, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
I20260809 23:21:53.826213 16211 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:21:53.827342 16259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:53.827536 16211 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:21:53.827623 16211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "104ce5f0e9aa41cf81bdb98f7440744a"
format_stamp: "Formatted at 2026-08-09 23:21:52 on dist-test-slave-6nmv"
server_key: "218f9d28035b2e633aaebfef31af9446"
server_key_iv: "008673c9751d7a3a705ba7ce1456cb73"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:53.828051 16211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:21:53.854964 16211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:21:53.857471 16211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:21:53.857690 16211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:21:53.857999 16211 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:21:53.858393 16211 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:21:53.858485 16211 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:53.858590 16211 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:21:53.858665 16211 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:53.865232 16211 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:43339
I20260809 23:21:53.865716 16211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:21:53.868189 16381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:43339 every 8 connection(s)
I20260809 23:21:53.870666 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 16211
I20260809 23:21:53.870955 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.235.148:54081/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:43489
--local_ip_for_outbound_sockets=127.1.235.130
--tserver_master_addrs=127.1.235.190:39993
--webserver_port=33705
--webserver_interface=127.1.235.130
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.235.148:54081/kms with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 23:21:53 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317713, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:21:53.880852 16384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:53.866681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39993 (local address 127.1.235.129:59771)
0809 23:21:53.867837 (+ 1156us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:53.867887 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:53.869177 (+ 1290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:53.869693 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:53.869697 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:53.870115 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:53.870298 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:53.870303 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:53.871727 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:53.871728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:53.872893 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:53.872896 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:53.874065 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:53.874066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:53.874191 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:53.874760 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:53.874769 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:53.876451 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:53.878774 (+ 2323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:53.878781 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:53.878784 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:53.879162 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:53.879446 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:53.879447 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:53.879447 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:53.879604 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:53.880169 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:53.880174 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:53.880325 (+ 151us) client_negotiation.cc:769] Sending connection context
0809 23:21:53.880432 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 23:21:53.880589 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1100,"thread_start_us":580,"threads_started":1}
I20260809 23:21:53.882023 16385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:53.867600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:59771 (local address 127.1.235.190:39993)
0809 23:21:53.868466 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:53.868475 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:53.868516 (+ 41us) server_negotiation.cc:407] Connection header received
0809 23:21:53.869421 (+ 905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:53.869426 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:53.869467 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:53.869626 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:53.870441 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:53.871585 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:53.872993 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:53.873813 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:53.873950 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:53.876573 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:53.876578 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:53.876578 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:53.876590 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:53.878674 (+ 2084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:53.879258 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:53.879261 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:53.879262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:53.879369 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:53.879696 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:53.879697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:53.879697 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:53.880040 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:53.880126 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:53.881620 (+ 1494us) server_negotiation.cc:299] Negotiation successful
0809 23:21:53.881743 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":97,"threads_started":1}
I20260809 23:21:53.883090 16382 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39993
I20260809 23:21:53.883185 16382 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:53.883354 16382 heartbeater.cc:511] Master 127.1.235.190:39993 requested a full tablet report, sending...
W20260809 23:21:53.884474 16382 heartbeater.cc:644] Failed to heartbeat to 127.1.235.190:39993 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 23:21:53.884577 16382 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:53.884642 16382 heartbeater.cc:511] Master 127.1.235.190:39993 requested a full tablet report, sending...
I20260809 23:21:53.885078 16382 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:53.885170 16382 heartbeater.cc:511] Master 127.1.235.190:39993 requested a full tablet report, sending...
W20260809 23:21:53.885597 16382 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 23:21:53.973053 16386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:21:53.973366 16386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:21:53.973425 16386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:21:53.975046 16386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:21:53.975116 16386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:21:53.975162 16386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:21:53.976661 16386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.235.148:54081/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:43489
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=33705
--tserver_master_addrs=127.1.235.190:39993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:21:53.976893 16386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:21:53.977118 16386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:21:53.982771 16392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:53.985981 16391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:53.986245 16394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:53.987491 16386 server_base.cc:1034] running on GCE node
I20260809 23:21:53.987687 16386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:21:53.987903 16386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:21:53.991158 16386 hybrid_clock.cc:648] HybridClock initialized: now 1786317713991127 us; error 41 us; skew 500 ppm
Aug 09 23:21:53 dist-test-slave-6nmv krb5kdc[15093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317713, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:21:53.994587 16386 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:21:53.995139 16386 webserver.cc:460] Webserver started at http://127.1.235.130:33705/ using document root <none> and password file <none>
I20260809 23:21:53.995404 16386 fs_manager.cc:359] Metadata directory not provided
I20260809 23:21:53.995498 16386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 23:21:53 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317713, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
I20260809 23:21:54.020627 16386 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.001s
I20260809 23:21:54.021721 16402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:54.021950 16386 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:21:54.022047 16386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "797adaa68cfe41f1a08361b5468943e5"
format_stamp: "Formatted at 2026-08-09 23:21:53 on dist-test-slave-6nmv"
server_key: "2d50f6a92f4435032cd0e4bc9d980556"
server_key_iv: "a262776c0b3bc20ac473b35938cc2d4d"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:54.022504 16386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:21:54.038777 16386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:21:54.040951 16386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:21:54.041098 16386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:21:54.041327 16386 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:21:54.041661 16386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:21:54.041730 16386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:54.041761 16386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:21:54.041850 16386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:54.049531 16386 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:43489
I20260809 23:21:54.049611 16532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:43489 every 8 connection(s)
I20260809 23:21:54.050091 16386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
Aug 09 23:21:54 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317713, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:21:54.058498 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 16386
I20260809 23:21:54.058795 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.1.235.148:54081/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:44559
--local_ip_for_outbound_sockets=127.1.235.131
--tserver_master_addrs=127.1.235.190:39993
--webserver_port=44147
--webserver_interface=127.1.235.131
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.1.235.148:54081/kms with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:21:54.059441 16385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:54.050875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:34453 (local address 127.1.235.190:39993)
0809 23:21:54.050931 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:54.050933 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:54.051128 (+ 195us) server_negotiation.cc:407] Connection header received
0809 23:21:54.051704 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:54.051705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:54.051718 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:54.051788 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:54.052295 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:54.053053 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:54.054011 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:54.054287 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:54.054362 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:54.056435 (+ 2073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:54.056436 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:54.056437 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:54.056444 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:54.057967 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:54.058356 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:54.058357 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:54.058357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:54.058428 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:54.058725 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:54.058726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:54.058726 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:54.058855 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:54.058937 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:54.059281 (+ 344us) server_negotiation.cc:299] Negotiation successful
0809 23:21:54.059359 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 23:21:54.059926 16535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:54.050821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39993 (local address 127.1.235.130:34453)
0809 23:21:54.050995 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:54.051033 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:54.051558 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:54.051854 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:54.051858 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:54.052025 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:54.052195 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:54.052199 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:54.053170 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:54.053171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:54.053933 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:54.053935 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:54.054379 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:54.054379 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:54.054465 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:54.055009 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:54.055016 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:54.056349 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:54.058051 (+ 1702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:54.058056 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:54.058057 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:54.058259 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:54.058498 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:54.058499 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:54.058499 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:54.058650 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:54.058969 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:54.058975 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:54.059125 (+ 150us) client_negotiation.cc:769] Sending connection context
0809 23:21:54.059576 (+ 451us) client_negotiation.cc:240] Negotiation successful
0809 23:21:54.059717 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":86,"threads_started":1}
I20260809 23:21:54.060911 16533 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39993
I20260809 23:21:54.061021 16533 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:54.061194 16533 heartbeater.cc:511] Master 127.1.235.190:39993 requested a full tablet report, sending...
W20260809 23:21:54.061869 16533 heartbeater.cc:644] Failed to heartbeat to 127.1.235.190:39993 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 23:21:54.061939 16533 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:54.062021 16533 heartbeater.cc:511] Master 127.1.235.190:39993 requested a full tablet report, sending...
I20260809 23:21:54.062372 16533 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:54.062458 16533 heartbeater.cc:511] Master 127.1.235.190:39993 requested a full tablet report, sending...
W20260809 23:21:54.062770 16533 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 23:21:54.152770 16536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:21:54.153002 16536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:21:54.153041 16536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:21:54.154253 16536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:21:54.154321 16536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:21:54.154366 16536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:21:54.155937 16536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.1.235.148:54081/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:44559
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=44147
--tserver_master_addrs=127.1.235.190:39993
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16536
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:21:54.156186 16536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:21:54.156446 16536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:21:54.161568 16545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:54.161917 16541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:54.162005 16542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:54.162348 16536 server_base.cc:1034] running on GCE node
I20260809 23:21:54.162545 16536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:21:54.162811 16536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:21:54.163967 16536 hybrid_clock.cc:648] HybridClock initialized: now 1786317714163950 us; error 35 us; skew 500 ppm
Aug 09 23:21:54 dist-test-slave-6nmv krb5kdc[15093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317714, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:21:54.166685 16536 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:21:54.167166 16536 webserver.cc:460] Webserver started at http://127.1.235.131:44147/ using document root <none> and password file <none>
I20260809 23:21:54.167400 16536 fs_manager.cc:359] Metadata directory not provided
I20260809 23:21:54.167483 16536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 23:21:54 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317714, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
I20260809 23:21:54.198251 16536 fs_manager.cc:709] Time spent opening directory manager: real 0.011s user 0.001s sys 0.000s
I20260809 23:21:54.199352 16554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:54.199523 16536 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:21:54.199606 16536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "5dc0baa511aa413487b4c056e8f43250"
format_stamp: "Formatted at 2026-08-09 23:21:53 on dist-test-slave-6nmv"
server_key: "f43ecde8aeb1e2f6a83110f3b8e61e1c"
server_key_iv: "7746835404097cb9182bf75cb1f0a1b8"
server_key_version: "kuduclusterkey@0"
I20260809 23:21:54.200037 16536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:21:54.228364 16536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:21:54.230198 16536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:21:54.230330 16536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:21:54.230527 16536 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:21:54.230899 16536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:21:54.230947 16536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:54.230971 16536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:21:54.231021 16536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:54.239035 16536 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:44559
I20260809 23:21:54.239115 16681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:44559 every 8 connection(s)
I20260809 23:21:54.239454 16536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
Aug 09 23:21:54 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317714, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:21:54.248823 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 16536
I20260809 23:21:54.250308 16385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:54.240214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:39803 (local address 127.1.235.190:39993)
0809 23:21:54.240255 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:54.240257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:54.240550 (+ 293us) server_negotiation.cc:407] Connection header received
0809 23:21:54.240993 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:54.240994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:54.241007 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:54.241075 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:54.241640 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:54.242358 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:54.243634 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:54.243861 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:54.243894 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:54.246329 (+ 2435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:54.246330 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:54.246330 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:54.246338 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:54.247955 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:54.248448 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:54.248450 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:54.248450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:54.248511 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:54.249562 (+ 1051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:54.249563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:54.249564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:54.249687 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:54.249730 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:54.250141 (+ 411us) server_negotiation.cc:299] Negotiation successful
0809 23:21:54.250222 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 23:21:54.250792 16684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:54.240221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39993 (local address 127.1.235.131:39803)
0809 23:21:54.240411 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:54.240461 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:54.240889 (+ 428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:54.241119 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:54.241122 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:54.241302 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:54.241534 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:54.241541 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:54.242464 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:54.242465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:54.243539 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:54.243543 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:54.244014 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:54.244015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:54.244130 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:54.244599 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:54.244608 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:54.246222 (+ 1614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:54.248047 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:54.248054 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:54.248056 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:54.248352 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:54.248593 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:54.248594 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:54.248594 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:54.249476 (+ 882us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:54.249779 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:54.249785 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:54.249987 (+ 202us) client_negotiation.cc:769] Sending connection context
0809 23:21:54.250435 (+ 448us) client_negotiation.cc:240] Negotiation successful
0809 23:21:54.250580 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":84,"threads_started":1}
I20260809 23:21:54.251212 16682 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39993
I20260809 23:21:54.251296 16682 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:54.251459 16682 heartbeater.cc:511] Master 127.1.235.190:39993 requested a full tablet report, sending...
W20260809 23:21:54.252108 16682 heartbeater.cc:644] Failed to heartbeat to 127.1.235.190:39993 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 23:21:54.252182 16682 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:54.252240 16682 heartbeater.cc:511] Master 127.1.235.190:39993 requested a full tablet report, sending...
I20260809 23:21:54.252560 16682 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:54.252647 16682 heartbeater.cc:511] Master 127.1.235.190:39993 requested a full tablet report, sending...
W20260809 23:21:54.253180 16682 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 23:21:54.256016 16686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:54.249266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37604 (local address 127.1.235.190:39993)
0809 23:21:54.249399 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:54.249401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:54.249500 (+ 99us) server_negotiation.cc:407] Connection header received
0809 23:21:54.249576 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:54.249577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:54.249586 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:54.249648 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:54.250266 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:54.250820 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:54.251684 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:54.251980 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:54.252042 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:54.253693 (+ 1651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:54.253694 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:54.253694 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:54.253699 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:54.254950 (+ 1251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:54.255339 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:54.255340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:54.255340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:54.255390 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:54.255588 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:54.255588 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:54.255588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:54.255670 (+ 82us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:54.255788 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:54.255894 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 23:21:54.255959 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":69,"threads_started":1}
Aug 09 23:21:54 dist-test-slave-6nmv krb5kdc[15093](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786317714, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:21:54.885855 16382 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:54.885998 16382 heartbeater.cc:511] Master 127.1.235.190:39993 requested a full tablet report, sending...
I20260809 23:21:54.886386 16170 ts_manager.cc:194] Registered new tserver with Master: 104ce5f0e9aa41cf81bdb98f7440744a (127.1.235.129:43339)
I20260809 23:21:54.887384 16170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:59771
I20260809 23:21:55.062984 16533 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:55.063145 16533 heartbeater.cc:511] Master 127.1.235.190:39993 requested a full tablet report, sending...
I20260809 23:21:55.063531 16170 ts_manager.cc:194] Registered new tserver with Master: 797adaa68cfe41f1a08361b5468943e5 (127.1.235.130:43489)
I20260809 23:21:55.064059 16170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:34453
Aug 09 23:21:55 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317714, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
I20260809 23:21:55.253400 16682 heartbeater.cc:464] Registering TS with master...
I20260809 23:21:55.253556 16682 heartbeater.cc:511] Master 127.1.235.190:39993 requested a full tablet report, sending...
I20260809 23:21:55.253861 16170 ts_manager.cc:194] Registered new tserver with Master: 5dc0baa511aa413487b4c056e8f43250 (127.1.235.131:44559)
I20260809 23:21:55.254352 16170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:39803
I20260809 23:21:55.258760 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:21:55.268180 16705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:55.259831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59318 (local address 127.1.235.190:39993)
0809 23:21:55.259949 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:55.259951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:55.260014 (+ 63us) server_negotiation.cc:407] Connection header received
0809 23:21:55.260100 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:55.260101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:55.260113 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:55.260230 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:55.260927 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.261773 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.262781 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.263096 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.263179 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:55.264892 (+ 1713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:55.264894 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:55.264894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:55.264902 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:55.266839 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:55.267268 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:55.267269 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:55.267270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:55.267341 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:55.267587 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:55.267588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:55.267588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:55.267724 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:55.267828 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:55.267988 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 23:21:55.268080 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":67,"threads_started":1}
I20260809 23:21:55.270730 16170 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59318:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:21:55.273092 16170 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:21:55.282558 16710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:55.277536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:43339 (local address 127.0.0.1:41474)
0809 23:21:55.277917 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:55.277927 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:55.278588 (+ 661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:55.278962 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:55.278975 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:55.278977 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:21:55.279017 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:55.279018 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.280194 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.280195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:55.281263 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:55.281266 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.282244 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.282245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:55.282329 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:55.282333 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:21:55.282414 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 23:21:55.282467 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"mutex_wait_us":16,"thread_start_us":73,"threads_started":1}
I20260809 23:21:55.282848 16714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:55.277172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:44559 (local address 127.0.0.1:34210)
0809 23:21:55.277671 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:55.277682 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:55.277725 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:55.278500 (+ 775us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:55.278503 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:55.278505 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:21:55.278584 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:55.278586 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.279760 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.279761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:55.281245 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:55.281248 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.282230 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.282231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:55.282314 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:55.282327 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 23:21:55.282734 (+ 407us) client_negotiation.cc:240] Negotiation successful
0809 23:21:55.282776 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"mutex_wait_us":3,"thread_start_us":81,"threads_started":1}
I20260809 23:21:55.283105 16715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:55.277735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41474 (local address 127.1.235.129:43339)
0809 23:21:55.278539 (+ 804us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:55.278544 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:55.278555 (+ 11us) server_negotiation.cc:407] Connection header received
0809 23:21:55.278687 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:55.278689 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:55.278705 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:55.278874 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:21:55.279097 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.280100 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.281356 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.282082 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.282155 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:55.282207 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:55.282955 (+ 748us) server_negotiation.cc:299] Negotiation successful
0809 23:21:55.283026 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":752,"thread_start_us":55,"threads_started":1}
I20260809 23:21:55.283371 16713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:55.277312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34210 (local address 127.1.235.131:44559)
0809 23:21:55.278236 (+ 924us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:55.278241 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:55.278251 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:21:55.278286 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:55.278288 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:55.278304 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:55.278388 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:21:55.278679 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.279660 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.281346 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.282052 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.282131 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:55.282189 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:55.283218 (+ 1029us) server_negotiation.cc:299] Negotiation successful
0809 23:21:55.283266 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":888,"thread_start_us":73,"threads_started":1}
I20260809 23:21:55.283914 16311 tablet_service.cc:1467] Processing CreateTablet for tablet 7687f7bfcb8a4bbf884b63a2d077806f (DEFAULT_TABLE table=test-table [id=b773f6551c74407b87accfe45e7b8c1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:21:55.284106 16609 tablet_service.cc:1467] Processing CreateTablet for tablet 7687f7bfcb8a4bbf884b63a2d077806f (DEFAULT_TABLE table=test-table [id=b773f6551c74407b87accfe45e7b8c1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:21:55.284302 16311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7687f7bfcb8a4bbf884b63a2d077806f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:21:55.284397 16609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7687f7bfcb8a4bbf884b63a2d077806f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:21:55.288141 16717 tablet_bootstrap.cc:492] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250: Bootstrap starting.
I20260809 23:21:55.288908 16717 tablet_bootstrap.cc:654] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250: Neither blocks nor log segments found. Creating new log.
I20260809 23:21:55.289350 16717 log.cc:824] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250: Log is configured to *not* fsync() on all Append() calls
I20260809 23:21:55.289736 16718 tablet_bootstrap.cc:492] T 7687f7bfcb8a4bbf884b63a2d077806f P 104ce5f0e9aa41cf81bdb98f7440744a: Bootstrap starting.
I20260809 23:21:55.290480 16718 tablet_bootstrap.cc:654] T 7687f7bfcb8a4bbf884b63a2d077806f P 104ce5f0e9aa41cf81bdb98f7440744a: Neither blocks nor log segments found. Creating new log.
I20260809 23:21:55.290580 16712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:55.276919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:43489 (local address 127.0.0.1:57056)
0809 23:21:55.277320 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:55.277387 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:55.277454 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:55.286157 (+ 8703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:55.286158 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:55.286161 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:21:55.286213 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:55.286215 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.287558 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.287560 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:55.289117 (+ 1557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:55.289121 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.290312 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.290313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:55.290413 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:55.290418 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 23:21:55.290461 (+ 43us) client_negotiation.cc:240] Negotiation successful
0809 23:21:55.290503 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":90,"threads_started":1}
I20260809 23:21:55.290879 16718 log.cc:824] T 7687f7bfcb8a4bbf884b63a2d077806f P 104ce5f0e9aa41cf81bdb98f7440744a: Log is configured to *not* fsync() on all Append() calls
I20260809 23:21:55.291204 16711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:55.277024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57056 (local address 127.1.235.130:43489)
0809 23:21:55.285950 (+ 8926us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:55.285955 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:55.285979 (+ 24us) server_negotiation.cc:407] Connection header received
0809 23:21:55.286014 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:55.286016 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:55.286033 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:55.286294 (+ 261us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:21:55.286401 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.287428 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.289297 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.290183 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.290963 (+ 780us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:55.291049 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:55.291078 (+ 29us) server_negotiation.cc:299] Negotiation successful
0809 23:21:55.291120 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8882,"thread_start_us":60,"threads_started":1}
I20260809 23:21:55.291724 16718 tablet_bootstrap.cc:492] T 7687f7bfcb8a4bbf884b63a2d077806f P 104ce5f0e9aa41cf81bdb98f7440744a: No bootstrap required, opened a new log
I20260809 23:21:55.291795 16718 ts_tablet_manager.cc:1397] T 7687f7bfcb8a4bbf884b63a2d077806f P 104ce5f0e9aa41cf81bdb98f7440744a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:21:55.291975 16456 tablet_service.cc:1467] Processing CreateTablet for tablet 7687f7bfcb8a4bbf884b63a2d077806f (DEFAULT_TABLE table=test-table [id=b773f6551c74407b87accfe45e7b8c1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:21:55.292301 16456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7687f7bfcb8a4bbf884b63a2d077806f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:21:55.294067 16718 raft_consensus.cc:348] T 7687f7bfcb8a4bbf884b63a2d077806f P 104ce5f0e9aa41cf81bdb98f7440744a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "797adaa68cfe41f1a08361b5468943e5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43489 } } peers { permanent_uuid: "104ce5f0e9aa41cf81bdb98f7440744a" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43339 } } peers { permanent_uuid: "5dc0baa511aa413487b4c056e8f43250" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44559 } }
I20260809 23:21:55.294212 16718 raft_consensus.cc:374] T 7687f7bfcb8a4bbf884b63a2d077806f P 104ce5f0e9aa41cf81bdb98f7440744a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:21:55.294237 16718 raft_consensus.cc:729] T 7687f7bfcb8a4bbf884b63a2d077806f P 104ce5f0e9aa41cf81bdb98f7440744a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104ce5f0e9aa41cf81bdb98f7440744a, State: Initialized, Role: FOLLOWER
I20260809 23:21:55.294330 16718 consensus_queue.cc:260] T 7687f7bfcb8a4bbf884b63a2d077806f P 104ce5f0e9aa41cf81bdb98f7440744a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "797adaa68cfe41f1a08361b5468943e5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43489 } } peers { permanent_uuid: "104ce5f0e9aa41cf81bdb98f7440744a" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43339 } } peers { permanent_uuid: "5dc0baa511aa413487b4c056e8f43250" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44559 } }
I20260809 23:21:55.294680 16718 ts_tablet_manager.cc:1428] T 7687f7bfcb8a4bbf884b63a2d077806f P 104ce5f0e9aa41cf81bdb98f7440744a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:21:55.295046 16382 heartbeater.cc:503] Master 127.1.235.190:39993 was elected leader, sending a full tablet report...
I20260809 23:21:55.296336 16722 tablet_bootstrap.cc:492] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5: Bootstrap starting.
I20260809 23:21:55.296912 16722 tablet_bootstrap.cc:654] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5: Neither blocks nor log segments found. Creating new log.
I20260809 23:21:55.297200 16722 log.cc:824] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5: Log is configured to *not* fsync() on all Append() calls
I20260809 23:21:55.298056 16722 tablet_bootstrap.cc:492] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5: No bootstrap required, opened a new log
I20260809 23:21:55.298168 16722 ts_tablet_manager.cc:1397] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:21:55.298431 16717 tablet_bootstrap.cc:492] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250: No bootstrap required, opened a new log
I20260809 23:21:55.298525 16717 ts_tablet_manager.cc:1397] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260809 23:21:55.300555 16722 raft_consensus.cc:348] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "797adaa68cfe41f1a08361b5468943e5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43489 } } peers { permanent_uuid: "104ce5f0e9aa41cf81bdb98f7440744a" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43339 } } peers { permanent_uuid: "5dc0baa511aa413487b4c056e8f43250" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44559 } }
I20260809 23:21:55.300685 16722 raft_consensus.cc:374] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:21:55.300715 16722 raft_consensus.cc:729] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 797adaa68cfe41f1a08361b5468943e5, State: Initialized, Role: FOLLOWER
I20260809 23:21:55.300799 16717 raft_consensus.cc:348] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "797adaa68cfe41f1a08361b5468943e5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43489 } } peers { permanent_uuid: "104ce5f0e9aa41cf81bdb98f7440744a" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43339 } } peers { permanent_uuid: "5dc0baa511aa413487b4c056e8f43250" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44559 } }
I20260809 23:21:55.300941 16717 raft_consensus.cc:374] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:21:55.300973 16717 raft_consensus.cc:729] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc0baa511aa413487b4c056e8f43250, State: Initialized, Role: FOLLOWER
I20260809 23:21:55.301065 16717 consensus_queue.cc:260] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "797adaa68cfe41f1a08361b5468943e5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43489 } } peers { permanent_uuid: "104ce5f0e9aa41cf81bdb98f7440744a" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43339 } } peers { permanent_uuid: "5dc0baa511aa413487b4c056e8f43250" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44559 } }
I20260809 23:21:55.300827 16722 consensus_queue.cc:260] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "797adaa68cfe41f1a08361b5468943e5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43489 } } peers { permanent_uuid: "104ce5f0e9aa41cf81bdb98f7440744a" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43339 } } peers { permanent_uuid: "5dc0baa511aa413487b4c056e8f43250" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44559 } }
I20260809 23:21:55.301290 16717 ts_tablet_manager.cc:1428] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:21:55.301404 16682 heartbeater.cc:503] Master 127.1.235.190:39993 was elected leader, sending a full tablet report...
I20260809 23:21:55.301668 16722 ts_tablet_manager.cc:1428] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:21:55.301934 16533 heartbeater.cc:503] Master 127.1.235.190:39993 was elected leader, sending a full tablet report...
I20260809 23:21:55.322484 16725 raft_consensus.cc:482] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:21:55.322649 16725 raft_consensus.cc:504] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "797adaa68cfe41f1a08361b5468943e5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43489 } } peers { permanent_uuid: "104ce5f0e9aa41cf81bdb98f7440744a" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43339 } } peers { permanent_uuid: "5dc0baa511aa413487b4c056e8f43250" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44559 } }
I20260809 23:21:55.323764 16725 leader_election.cc:288] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 104ce5f0e9aa41cf81bdb98f7440744a (127.1.235.129:43339), 5dc0baa511aa413487b4c056e8f43250 (127.1.235.131:44559)
I20260809 23:21:55.327755 16715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:55.323378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:60905 (local address 127.1.235.129:43339)
0809 23:21:55.323433 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:55.323436 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:55.323993 (+ 557us) server_negotiation.cc:407] Connection header received
0809 23:21:55.324091 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:55.324092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:55.324101 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:55.324129 (+ 28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:21:55.324326 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.325028 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.326778 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.327269 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.327317 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:55.327326 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:55.327634 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 23:21:55.327674 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 23:21:55.328208 16726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:55.323158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:43339 (local address 127.1.235.130:60905)
0809 23:21:55.323926 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:55.323937 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:55.324020 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:55.324190 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:55.324190 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:55.324192 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:21:55.324259 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:55.324260 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.325426 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.325427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:55.326658 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:55.326661 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.327425 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.327426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:55.327522 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:55.327525 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:21:55.328045 (+ 520us) client_negotiation.cc:240] Negotiation successful
0809 23:21:55.328102 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":751,"thread_start_us":99,"threads_started":1}
I20260809 23:21:55.328697 16334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7687f7bfcb8a4bbf884b63a2d077806f" candidate_uuid: "797adaa68cfe41f1a08361b5468943e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104ce5f0e9aa41cf81bdb98f7440744a" is_pre_election: true
I20260809 23:21:55.328863 16334 raft_consensus.cc:2454] T 7687f7bfcb8a4bbf884b63a2d077806f P 104ce5f0e9aa41cf81bdb98f7440744a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 797adaa68cfe41f1a08361b5468943e5 in term 0.
I20260809 23:21:55.329285 16404 leader_election.cc:302] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104ce5f0e9aa41cf81bdb98f7440744a, 797adaa68cfe41f1a08361b5468943e5; no voters:
I20260809 23:21:55.329470 16725 raft_consensus.cc:2781] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:21:55.329528 16725 raft_consensus.cc:482] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:21:55.329553 16725 raft_consensus.cc:3037] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:21:55.330619 16725 raft_consensus.cc:504] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "797adaa68cfe41f1a08361b5468943e5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43489 } } peers { permanent_uuid: "104ce5f0e9aa41cf81bdb98f7440744a" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43339 } } peers { permanent_uuid: "5dc0baa511aa413487b4c056e8f43250" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44559 } }
I20260809 23:21:55.330951 16334 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7687f7bfcb8a4bbf884b63a2d077806f" candidate_uuid: "797adaa68cfe41f1a08361b5468943e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104ce5f0e9aa41cf81bdb98f7440744a"
I20260809 23:21:55.331024 16334 raft_consensus.cc:3037] T 7687f7bfcb8a4bbf884b63a2d077806f P 104ce5f0e9aa41cf81bdb98f7440744a [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:21:55.331925 16334 raft_consensus.cc:2454] T 7687f7bfcb8a4bbf884b63a2d077806f P 104ce5f0e9aa41cf81bdb98f7440744a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 797adaa68cfe41f1a08361b5468943e5 in term 1.
I20260809 23:21:55.332192 16404 leader_election.cc:302] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104ce5f0e9aa41cf81bdb98f7440744a, 797adaa68cfe41f1a08361b5468943e5; no voters:
I20260809 23:21:55.332439 16725 leader_election.cc:288] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [CANDIDATE]: Term 1 election: Requested vote from peers 104ce5f0e9aa41cf81bdb98f7440744a (127.1.235.129:43339), 5dc0baa511aa413487b4c056e8f43250 (127.1.235.131:44559)
I20260809 23:21:55.332530 16725 raft_consensus.cc:2781] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:21:55.332603 16725 raft_consensus.cc:686] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [term 1 LEADER]: Becoming Leader. State: Replica: 797adaa68cfe41f1a08361b5468943e5, State: Running, Role: LEADER
I20260809 23:21:55.332718 16725 consensus_queue.cc:237] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "797adaa68cfe41f1a08361b5468943e5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43489 } } peers { permanent_uuid: "104ce5f0e9aa41cf81bdb98f7440744a" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43339 } } peers { permanent_uuid: "5dc0baa511aa413487b4c056e8f43250" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44559 } }
I20260809 23:21:55.333630 16170 catalog_manager.cc:5495] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 797adaa68cfe41f1a08361b5468943e5 (127.1.235.130). New cstate: current_term: 1 leader_uuid: "797adaa68cfe41f1a08361b5468943e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "797adaa68cfe41f1a08361b5468943e5" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43489 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "104ce5f0e9aa41cf81bdb98f7440744a" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43339 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dc0baa511aa413487b4c056e8f43250" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44559 } health_report { overall_health: UNKNOWN } } }
I20260809 23:21:55.335603 16713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:55.323707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:46997 (local address 127.1.235.131:44559)
0809 23:21:55.323746 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:55.323748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:55.325057 (+ 1309us) server_negotiation.cc:407] Connection header received
0809 23:21:55.326010 (+ 953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:55.326011 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:55.326033 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:55.326060 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:21:55.327404 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.328094 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.334393 (+ 6299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.334977 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.335056 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:55.335066 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:55.335496 (+ 430us) server_negotiation.cc:299] Negotiation successful
0809 23:21:55.335538 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 23:21:55.335964 16727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:55.323542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:44559 (local address 127.1.235.130:46997)
0809 23:21:55.324981 (+ 1439us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:55.324993 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:55.325896 (+ 903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:55.326119 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:55.326120 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:55.326122 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:21:55.326185 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:55.326186 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.328210 (+ 2024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.328211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:55.334274 (+ 6063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:55.334277 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.335321 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.335322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:55.335399 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:55.335403 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:21:55.335829 (+ 426us) client_negotiation.cc:240] Negotiation successful
0809 23:21:55.335871 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1416,"thread_start_us":66,"threads_started":1}
I20260809 23:21:55.336424 16631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7687f7bfcb8a4bbf884b63a2d077806f" candidate_uuid: "797adaa68cfe41f1a08361b5468943e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc0baa511aa413487b4c056e8f43250" is_pre_election: true
I20260809 23:21:55.336549 16631 raft_consensus.cc:2454] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 797adaa68cfe41f1a08361b5468943e5 in term 0.
I20260809 23:21:55.336647 16630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7687f7bfcb8a4bbf884b63a2d077806f" candidate_uuid: "797adaa68cfe41f1a08361b5468943e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc0baa511aa413487b4c056e8f43250"
I20260809 23:21:55.336717 16630 raft_consensus.cc:3037] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:21:55.337502 16630 raft_consensus.cc:2454] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 797adaa68cfe41f1a08361b5468943e5 in term 1.
I20260809 23:21:55.342093 16711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:55.339545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57072 (local address 127.1.235.130:43489)
0809 23:21:55.339578 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:55.339580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:55.339586 (+ 6us) server_negotiation.cc:407] Connection header received
0809 23:21:55.339611 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:55.339612 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:55.339627 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:55.339679 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:21:55.339829 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.340422 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.341185 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:55.341490 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:55.341567 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:55.341722 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:21:55.341847 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:21:55.341926 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:55.342018 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 23:21:55.342039 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 23:21:55.343593 16630 raft_consensus.cc:1261] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250 [term 1 FOLLOWER]: Refusing update from remote peer 797adaa68cfe41f1a08361b5468943e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:21:55.343629 16334 raft_consensus.cc:1261] T 7687f7bfcb8a4bbf884b63a2d077806f P 104ce5f0e9aa41cf81bdb98f7440744a [term 1 FOLLOWER]: Refusing update from remote peer 797adaa68cfe41f1a08361b5468943e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:21:55.343922 16728 consensus_queue.cc:1035] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc0baa511aa413487b4c056e8f43250" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:21:55.344036 16725 consensus_queue.cc:1035] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "104ce5f0e9aa41cf81bdb98f7440744a" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43339 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:21:55.347707 16734 mvcc.cc:205] Tried to move back new op lower bound from 7316757362045087744 to 7316757362003828736. Current Snapshot: MvccSnapshot[applied={T|T < 7316757362045087744}]
I20260809 23:21:55.348649 16733 mvcc.cc:205] Tried to move back new op lower bound from 7316757362045087744 to 7316757362003828736. Current Snapshot: MvccSnapshot[applied={T|T < 7316757362045087744}]
I20260809 23:21:55.350309 16735 mvcc.cc:205] Tried to move back new op lower bound from 7316757362045087744 to 7316757362003828736. Current Snapshot: MvccSnapshot[applied={T|T < 7316757362045087744}]
I20260809 23:21:55.350644 16168 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59318:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:21:55.350754 16168 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59318:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:21:55.351797 16168 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e781ea3740e841eeba9850ba7073f668: Sending DeleteTablet for 3 replicas of tablet 7687f7bfcb8a4bbf884b63a2d077806f
I20260809 23:21:55.352290 16456 tablet_service.cc:1514] Processing DeleteTablet for tablet 7687f7bfcb8a4bbf884b63a2d077806f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:21:55 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:57056
I20260809 23:21:55.352526 16609 tablet_service.cc:1514] Processing DeleteTablet for tablet 7687f7bfcb8a4bbf884b63a2d077806f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:21:55 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:34210
I20260809 23:21:55.352998 16311 tablet_service.cc:1514] Processing DeleteTablet for tablet 7687f7bfcb8a4bbf884b63a2d077806f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:21:55 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:41474
I20260809 23:21:55.353264 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 16211
I20260809 23:21:55.356381 16743 tablet_replica.cc:330] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5: stopping tablet replica
I20260809 23:21:55.356508 16744 tablet_replica.cc:330] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250: stopping tablet replica
I20260809 23:21:55.356654 16744 raft_consensus.cc:2229] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:21:55.356769 16743 raft_consensus.cc:2229] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:21:55.356950 16743 raft_consensus.cc:2258] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:21:55.357071 16744 raft_consensus.cc:2258] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:21:55.357734 16743 ts_tablet_manager.cc:1905] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:21:55.359637 16743 ts_tablet_manager.cc:1918] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:21:55.359794 16743 log.cc:1196] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/7687f7bfcb8a4bbf884b63a2d077806f
I20260809 23:21:55.360177 16743 ts_tablet_manager.cc:1939] T 7687f7bfcb8a4bbf884b63a2d077806f P 797adaa68cfe41f1a08361b5468943e5: Deleting consensus metadata
I20260809 23:21:55.360666 16155 catalog_manager.cc:4841] TS 797adaa68cfe41f1a08361b5468943e5 (127.1.235.130:43489): tablet 7687f7bfcb8a4bbf884b63a2d077806f (table test-table [id=b773f6551c74407b87accfe45e7b8c1a]) successfully deleted
W20260809 23:21:55.362249 16152 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.235.129:43339 (error 108)
I20260809 23:21:55.363124 16712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:55.362984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:43339 (local address 127.0.0.1:41476)
0809 23:21:55.363048 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:55.363089 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.129:43339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 23:21:55.363234 16152 catalog_manager.cc:4584] TS 104ce5f0e9aa41cf81bdb98f7440744a (127.1.235.129:43339): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7687f7bfcb8a4bbf884b63a2d077806f: Network error: Client connection negotiation failed: client connection to 127.1.235.129:43339: connect: Connection refused (error 111)
I20260809 23:21:55.365952 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 16386
Aug 09 23:21:55 dist-test-slave-6nmv krb5kdc[15093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317714, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for HTTP/127.1.235.148@KRBTEST.COM
I20260809 23:21:55.378858 16744 ts_tablet_manager.cc:1905] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:21:55.380421 16744 ts_tablet_manager.cc:1918] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:21:55.380512 16744 log.cc:1196] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/7687f7bfcb8a4bbf884b63a2d077806f
I20260809 23:21:55.380776 16744 ts_tablet_manager.cc:1939] T 7687f7bfcb8a4bbf884b63a2d077806f P 5dc0baa511aa413487b4c056e8f43250: Deleting consensus metadata
I20260809 23:21:55.381224 16154 catalog_manager.cc:4841] TS 5dc0baa511aa413487b4c056e8f43250 (127.1.235.131:44559): tablet 7687f7bfcb8a4bbf884b63a2d077806f (table test-table [id=b773f6551c74407b87accfe45e7b8c1a]) successfully deleted
I20260809 23:21:55.386350 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 16536
I20260809 23:21:55.392894 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 16132
I20260809 23:21:55.403903 1966 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 23:21:55.747900 1966 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 23:21:55.748023 1966 mini_ranger.cc:66] Stopping Ranger...
I20260809 23:21:56.091764 1966 mini_ranger.cc:68] Stopped Ranger
2026-08-09 23:21:56.092 UTC [15124] LOG: received smart shutdown request
2026-08-09 23:21:56.095 UTC [15124] LOG: background worker "logical replication launcher" (PID 15133) exited with exit code 1
2026-08-09 23:21:56.096 UTC [15128] LOG: shutting down
2026-08-09 23:21:56.257 UTC [15124] LOG: database system is shut down
2026-08-09T23:21:56Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47215 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:21:56 dist-test-slave-6nmv krb5kdc[16756](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:21:56 dist-test-slave-6nmv krb5kdc[16756](info): set up 2 sockets
Aug 09 23:21:56 dist-test-slave-6nmv krb5kdc[16756](info): commencing operation
krb5kdc: starting...
W20260809 23:21:57.406061 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:21:57 dist-test-slave-6nmv krb5kdc[16756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317717, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:21:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:21:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:21:57.517006 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:44447
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:40253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:44447,127.1.235.189:33329,127.1.235.188:42671
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:21:57.593000 16769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:21:57.593192 16769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:21:57.593225 16769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:21:57.594324 16769 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:21:57.594379 16769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:21:57.594401 16769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:21:57.594445 16769 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:21:57.594470 16769 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:21:57.595890 16769 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:40253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:44447,127.1.235.189:33329,127.1.235.188:42671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:44447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:21:57.596151 16769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:21:57.596374 16769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:21:57.600879 16776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:57.600976 16777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:57.600880 16779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:57.600996 16769 server_base.cc:1034] running on GCE node
I20260809 23:21:57.601282 16769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:21:57.601495 16769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:21:57.602671 16769 hybrid_clock.cc:648] HybridClock initialized: now 1786317717602661 us; error 42 us; skew 500 ppm
Aug 09 23:21:57 dist-test-slave-6nmv krb5kdc[16756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317717, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:21:57.607836 16769 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:21:57.608168 16769 webserver.cc:460] Webserver started at http://127.1.235.190:41253/ using document root <none> and password file <none>
I20260809 23:21:57.608328 16769 fs_manager.cc:359] Metadata directory not provided
I20260809 23:21:57.608362 16769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:21:57.608458 16769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:21:57.609288 16769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c"
format_stamp: "Formatted at 2026-08-09 23:21:57 on dist-test-slave-6nmv"
server_key: "7985af509520aeb1e244e8516f6acb2a"
server_key_iv: "da196381bce726baa972d81c85ca78e9"
server_key_version: "encryptionkey@0"
I20260809 23:21:57.609562 16769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c"
format_stamp: "Formatted at 2026-08-09 23:21:57 on dist-test-slave-6nmv"
server_key: "7985af509520aeb1e244e8516f6acb2a"
server_key_iv: "da196381bce726baa972d81c85ca78e9"
server_key_version: "encryptionkey@0"
I20260809 23:21:57.610807 16769 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 23:21:57.611521 16787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:57.611720 16769 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:21:57.611799 16769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c"
format_stamp: "Formatted at 2026-08-09 23:21:57 on dist-test-slave-6nmv"
server_key: "7985af509520aeb1e244e8516f6acb2a"
server_key_iv: "da196381bce726baa972d81c85ca78e9"
server_key_version: "encryptionkey@0"
I20260809 23:21:57.611865 16769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:21:57.626133 16769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:21:57.628017 16769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:21:57.628124 16769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:21:57.632061 16769 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:44447
I20260809 23:21:57.632120 16845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:44447 every 8 connection(s)
I20260809 23:21:57.632647 16769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:21:57.633456 16846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:21:57.635159 16846 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 23:21:57 dist-test-slave-6nmv krb5kdc[16756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317717, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:21:57.641491 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 16769
I20260809 23:21:57.641620 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:21:57.641803 1966 external_mini_cluster.cc:1428] Setting key 53af857abf0a849bc86ec27b4540e100
I20260809 23:21:57.644393 16848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.635793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44447 (local address 127.0.0.1:34556)
0809 23:21:57.635970 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.636009 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:57.636451 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:57.636690 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:57.636693 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:57.636922 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:57.637061 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:57.637064 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.638078 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.638078 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:57.638709 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:57.638711 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.639180 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.639181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:57.639252 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.639699 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:57.639706 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:57.641048 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:57.642845 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:57.642853 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:57.642855 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:57.643129 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:57.643399 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:57.643400 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:57.643400 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:57.643524 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:57.643965 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:57.643971 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:57.644027 (+ 56us) client_negotiation.cc:769] Sending connection context
0809 23:21:57.644108 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 23:21:57.644229 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":88,"threads_started":1}
I20260809 23:21:57.644469 16849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.635960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34556 (local address 127.1.235.190:44447)
0809 23:21:57.636143 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:57.636147 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:57.636176 (+ 29us) server_negotiation.cc:407] Connection header received
0809 23:21:57.636567 (+ 391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:57.636568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:57.636584 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:57.636666 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:57.637144 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.637984 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.638785 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.639104 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.639186 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.641128 (+ 1942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:57.641135 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:57.641135 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:57.641141 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:57.642763 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.643243 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.643245 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.643245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.643321 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.643608 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.643610 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.643610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.643888 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:57.643977 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:57.644161 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 23:21:57.644319 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":146,"thread_start_us":119,"threads_started":1}
I20260809 23:21:57.645466 16846 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:21:57.645884 16848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.645702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:33329 (local address 127.0.0.1:54482)
0809 23:21:57.645753 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.645801 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:33329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 23:21:57.646032 16791 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.235.189:33329: connect: Connection refused (error 111)
I20260809 23:21:57.646495 16848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.646406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:33329 (local address 127.0.0.1:54492)
0809 23:21:57.646450 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.646474 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:33329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 23:21:57.646597 16846 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.189:33329: Network error: Client connection negotiation failed: client connection to 127.1.235.189:33329: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.1.235.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.189.keytab.
Entry for principal kudu/127.1.235.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.189.keytab.
I20260809 23:21:57.666344 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.189:33329
--webserver_interface=127.1.235.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.189.keytab
--principal=kudu/127.1.235.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:40253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:44447,127.1.235.189:33329,127.1.235.188:42671
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:21:57.695816 16846 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } attempt: 1
I20260809 23:21:57.696327 16848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.696169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:33329 (local address 127.0.0.1:54496)
0809 23:21:57.696239 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.696282 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:33329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260809 23:21:57.696699 16848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.696605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:33329 (local address 127.0.0.1:54508)
0809 23:21:57.696651 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.696679 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:33329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 23:21:57.696791 16846 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.189:33329: Network error: Client connection negotiation failed: client connection to 127.1.235.189:33329: connect: Connection refused (error 111)
W20260809 23:21:57.741698 16854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:21:57.741879 16854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:21:57.741899 16854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:21:57.742826 16854 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:21:57.742859 16854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:21:57.742870 16854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:21:57.742882 16854 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:21:57.742892 16854 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:21:57.744072 16854 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:40253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:44447,127.1.235.189:33329,127.1.235.188:42671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.189.keytab
--principal=kudu/127.1.235.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.189:33329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.235.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:21:57.744225 16854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:21:57.744362 16854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:21:57.748493 16860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:57.748538 16863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:57.748548 16854 server_base.cc:1034] running on GCE node
W20260809 23:21:57.748508 16859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:57.748826 16854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:21:57.749023 16854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:21:57.750191 16854 hybrid_clock.cc:648] HybridClock initialized: now 1786317717750168 us; error 24 us; skew 500 ppm
Aug 09 23:21:57 dist-test-slave-6nmv krb5kdc[16756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317717, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:21:57.752417 16854 init.cc:377] Logged in from keytab as kudu/127.1.235.189@KRBTEST.COM (short username kudu)
I20260809 23:21:57.752846 16854 webserver.cc:460] Webserver started at http://127.1.235.189:35361/ using document root <none> and password file <none>
I20260809 23:21:57.753051 16854 fs_manager.cc:359] Metadata directory not provided
I20260809 23:21:57.753110 16854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:21:57.753232 16854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:21:57.754150 16854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-1/data/instance:
uuid: "67b5c7cdb7874320ae0d776341f2ce99"
format_stamp: "Formatted at 2026-08-09 23:21:57 on dist-test-slave-6nmv"
server_key: "dbfc16d913ae155fa0a76658f60b810d"
server_key_iv: "18a3f9f7e12812f78bc2abc8ea619abe"
server_key_version: "encryptionkey@0"
I20260809 23:21:57.754462 16854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-1/wal/instance:
uuid: "67b5c7cdb7874320ae0d776341f2ce99"
format_stamp: "Formatted at 2026-08-09 23:21:57 on dist-test-slave-6nmv"
server_key: "dbfc16d913ae155fa0a76658f60b810d"
server_key_iv: "18a3f9f7e12812f78bc2abc8ea619abe"
server_key_version: "encryptionkey@0"
I20260809 23:21:57.755674 16854 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:21:57.756449 16871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:57.756628 16854 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:21:57.756716 16854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-1/wal
uuid: "67b5c7cdb7874320ae0d776341f2ce99"
format_stamp: "Formatted at 2026-08-09 23:21:57 on dist-test-slave-6nmv"
server_key: "dbfc16d913ae155fa0a76658f60b810d"
server_key_iv: "18a3f9f7e12812f78bc2abc8ea619abe"
server_key_version: "encryptionkey@0"
I20260809 23:21:57.756788 16854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:21:57.764918 16846 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } attempt: 2
I20260809 23:21:57.765331 16848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.765213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:33329 (local address 127.0.0.1:54524)
0809 23:21:57.765268 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.765302 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:33329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 23:21:57.765712 16848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.765633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:33329 (local address 127.0.0.1:54540)
0809 23:21:57.765672 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.765697 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:33329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260809 23:21:57.765872 16846 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.189:33329: Network error: Client connection negotiation failed: client connection to 127.1.235.189:33329: connect: Connection refused (error 111)
I20260809 23:21:57.767238 16854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:21:57.768786 16854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:21:57.768915 16854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:21:57.772889 16854 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.189:33329
I20260809 23:21:57.773151 16933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.189:33329 every 8 connection(s)
I20260809 23:21:57.773197 16854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-1/data/info.pb
I20260809 23:21:57.773775 16934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:21:57.775092 16934 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 23:21:57 dist-test-slave-6nmv krb5kdc[16756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317717, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.189@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:21:57.780694 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 16854
I20260809 23:21:57.780818 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-1/wal/instance
I20260809 23:21:57.781039 1966 external_mini_cluster.cc:1428] Setting key f1d63cf339843f758a8d4c72dc21ab27
I20260809 23:21:57.783946 16849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.775740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34572 (local address 127.1.235.190:44447)
0809 23:21:57.775782 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:57.775785 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:57.775990 (+ 205us) server_negotiation.cc:407] Connection header received
0809 23:21:57.776475 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:57.776476 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:57.776489 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:57.776546 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:57.777108 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.777580 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.778581 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.778802 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.778887 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.780767 (+ 1880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:57.780769 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:57.780769 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:57.780777 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:57.782376 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.782800 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.782802 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.782802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.782864 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.783248 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.783249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.783249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.783404 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:57.783496 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:57.783761 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 23:21:57.783857 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 23:21:57.784148 16936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.775685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44447 (local address 127.0.0.1:34572)
0809 23:21:57.775852 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.775910 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:57.776364 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:57.776606 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:57.776609 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:57.776832 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:57.777012 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:57.777015 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.777676 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.777677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:57.778484 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:57.778486 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.778929 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.778930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:57.779049 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.779446 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:57.779453 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:57.780676 (+ 1223us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:57.782474 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:57.782482 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:57.782484 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:57.782708 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:57.782993 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:57.782994 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:57.782994 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:57.783140 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:57.783487 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:57.783495 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:57.783621 (+ 126us) client_negotiation.cc:769] Sending connection context
0809 23:21:57.783738 (+ 117us) client_negotiation.cc:240] Negotiation successful
0809 23:21:57.783902 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":62,"threads_started":1}
I20260809 23:21:57.784866 16934 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.235.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.188@KRBTEST.COM" created.
Aug 09 23:21:57 dist-test-slave-6nmv krb5kdc[16756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317717, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.189@KRBTEST.COM for kudu/127.1.235.189@KRBTEST.COM
I20260809 23:21:57.795048 16936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.785192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:33329 (local address 127.0.0.1:54552)
0809 23:21:57.785415 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.785426 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:57.785481 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:57.785639 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:57.785640 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:57.785791 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:57.785896 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:57.785898 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.786818 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.786819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:57.787330 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:57.787332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.787831 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.787832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:57.787906 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.788329 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:57.788334 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:57.791941 (+ 3607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:57.793960 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:57.793961 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:57.793961 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:57.794107 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:57.794318 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:57.794319 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:57.794319 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:57.794367 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:57.794635 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:57.794636 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:57.794670 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 23:21:57.794729 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 23:21:57.794814 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211}
I20260809 23:21:57.795240 16938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.785230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54552 (local address 127.1.235.189:33329)
0809 23:21:57.785426 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:57.785431 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:57.785478 (+ 47us) server_negotiation.cc:407] Connection header received
0809 23:21:57.785544 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:57.785546 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:57.785560 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:57.785638 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:57.785999 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.786699 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.787438 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.787728 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.787830 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.792047 (+ 4217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:57.792054 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:57.792055 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:57.792062 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:57.793882 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.794198 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.794201 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.794201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.794252 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.794443 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.794444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.794445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.794565 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:57.794652 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:57.794752 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 23:21:57.794860 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":163,"thread_start_us":115,"threads_started":1}
I20260809 23:21:57.795775 16934 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:21:57.796084 16936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.795969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42671 (local address 127.0.0.1:48904)
0809 23:21:57.796015 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.796056 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:42671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260809 23:21:57.796200 16878 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.235.188:42671: connect: Connection refused (error 111)
I20260809 23:21:57.796643 16936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.796528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42671 (local address 127.0.0.1:48908)
0809 23:21:57.796573 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.796615 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:42671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260809 23:21:57.796751 16934 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.188:42671: Network error: Client connection negotiation failed: client connection to 127.1.235.188:42671: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.188.keytab.
Entry for principal kudu/127.1.235.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.188.keytab.
I20260809 23:21:57.808065 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.188:42671
--webserver_interface=127.1.235.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.188.keytab
--principal=kudu/127.1.235.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:40253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:44447,127.1.235.189:33329,127.1.235.188:42671
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:21:57.845956 16934 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } attempt: 1
I20260809 23:21:57.846484 16936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.846350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42671 (local address 127.0.0.1:48920)
0809 23:21:57.846419 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.846457 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:42671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 23:21:57.846866 16936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.846792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42671 (local address 127.0.0.1:48932)
0809 23:21:57.846828 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.846850 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:42671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260809 23:21:57.846982 16934 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.188:42671: Network error: Client connection negotiation failed: client connection to 127.1.235.188:42671: connect: Connection refused (error 111)
I20260809 23:21:57.857057 16846 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } attempt: 3
Aug 09 23:21:57 dist-test-slave-6nmv krb5kdc[16756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317717, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for kudu/127.1.235.189@KRBTEST.COM
I20260809 23:21:57.864135 16938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.857439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54564 (local address 127.1.235.189:33329)
0809 23:21:57.857510 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:57.857512 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:57.857521 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:21:57.857599 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:57.857600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:57.857609 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:57.857654 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:57.858048 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.858470 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.859390 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.859574 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.859623 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.861652 (+ 2029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:57.861653 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:57.861654 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:57.861666 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:57.863055 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.863386 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.863388 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.863388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.863448 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.863650 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.863651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.863651 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.863756 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:57.863839 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:57.863984 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 23:21:57.864054 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 23:21:57.864138 16848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.857370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:33329 (local address 127.0.0.1:54564)
0809 23:21:57.857416 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.857429 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:57.857514 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:57.857683 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:57.857684 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:57.857891 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:57.857967 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:57.857970 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.858547 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.858549 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:57.859311 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:57.859315 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.859644 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.859645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:57.859722 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.860205 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:57.860210 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:57.861561 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:57.863139 (+ 1578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:57.863140 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:57.863140 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:57.863311 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:57.863521 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:57.863522 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:57.863522 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:57.863583 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:57.863842 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:57.863843 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:57.863887 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 23:21:57.863960 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 23:21:57.864054 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260809 23:21:57.864513 16846 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:21:57.864858 16848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.864768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42671 (local address 127.0.0.1:48942)
0809 23:21:57.864816 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.864841 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:42671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 23:21:57.865206 16848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.865114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42671 (local address 127.0.0.1:48952)
0809 23:21:57.865159 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.865183 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:42671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 23:21:57.865298 16846 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.188:42671: Network error: Client connection negotiation failed: client connection to 127.1.235.188:42671: connect: Connection refused (error 111)
W20260809 23:21:57.889277 16941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:21:57.889469 16941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:21:57.889504 16941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:21:57.890556 16941 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:21:57.890616 16941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:21:57.890641 16941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:21:57.890668 16941 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:21:57.890691 16941 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:21:57.892169 16941 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:40253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:44447,127.1.235.189:33329,127.1.235.188:42671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.188.keytab
--principal=kudu/127.1.235.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.188:42671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.235.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:21:57.892426 16941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:21:57.892633 16941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 23:21:57.896479 16846 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } attempt: 1
I20260809 23:21:57.896908 16848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.896721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42671 (local address 127.0.0.1:48968)
0809 23:21:57.896846 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.896876 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:42671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
W20260809 23:21:57.897017 16947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:57.897013 16952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:21:57.897032 16946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:21:57.897504 16848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.897384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42671 (local address 127.0.0.1:48976)
0809 23:21:57.897446 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.897476 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:42671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 23:21:57.897480 16941 server_base.cc:1034] running on GCE node
W20260809 23:21:57.897609 16846 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.188:42671: Network error: Client connection negotiation failed: client connection to 127.1.235.188:42671: connect: Connection refused (error 111)
I20260809 23:21:57.897711 16941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:21:57.898010 16941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:21:57.899307 16941 hybrid_clock.cc:648] HybridClock initialized: now 1786317717899283 us; error 40 us; skew 500 ppm
Aug 09 23:21:57 dist-test-slave-6nmv krb5kdc[16756](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317717, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:21:57.901640 16941 init.cc:377] Logged in from keytab as kudu/127.1.235.188@KRBTEST.COM (short username kudu)
I20260809 23:21:57.902087 16941 webserver.cc:460] Webserver started at http://127.1.235.188:41509/ using document root <none> and password file <none>
I20260809 23:21:57.902305 16941 fs_manager.cc:359] Metadata directory not provided
I20260809 23:21:57.902367 16941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:21:57.902518 16941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:21:57.903482 16941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-2/data/instance:
uuid: "314c4b282e854934a86d719e392c90f9"
format_stamp: "Formatted at 2026-08-09 23:21:57 on dist-test-slave-6nmv"
server_key: "b5411967ca37cd49e2ce123bcbb44975"
server_key_iv: "9a67834881c5a97edf2693a2da49c5e2"
server_key_version: "encryptionkey@0"
I20260809 23:21:57.903831 16941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-2/wal/instance:
uuid: "314c4b282e854934a86d719e392c90f9"
format_stamp: "Formatted at 2026-08-09 23:21:57 on dist-test-slave-6nmv"
server_key: "b5411967ca37cd49e2ce123bcbb44975"
server_key_iv: "9a67834881c5a97edf2693a2da49c5e2"
server_key_version: "encryptionkey@0"
I20260809 23:21:57.905408 16941 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:21:57.906213 16962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:57.906396 16941 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:21:57.906486 16941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-2/wal
uuid: "314c4b282e854934a86d719e392c90f9"
format_stamp: "Formatted at 2026-08-09 23:21:57 on dist-test-slave-6nmv"
server_key: "b5411967ca37cd49e2ce123bcbb44975"
server_key_iv: "9a67834881c5a97edf2693a2da49c5e2"
server_key_version: "encryptionkey@0"
I20260809 23:21:57.906566 16941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:21:57.915148 16934 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } attempt: 2
I20260809 23:21:57.915531 16936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.915407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42671 (local address 127.0.0.1:48980)
0809 23:21:57.915465 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.915502 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:42671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 23:21:57.915932 16936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.915831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42671 (local address 127.0.0.1:48996)
0809 23:21:57.915881 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.915909 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:42671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 23:21:57.916049 16934 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.188:42671: Network error: Client connection negotiation failed: client connection to 127.1.235.188:42671: connect: Connection refused (error 111)
I20260809 23:21:57.922525 16941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:21:57.924297 16941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:21:57.924456 16941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:21:57.928467 16941 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.188:42671
I20260809 23:21:57.928498 17017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.188:42671 every 8 connection(s)
I20260809 23:21:57.928828 16941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-2/data/info.pb
I20260809 23:21:57.929632 17018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:21:57.930979 17018 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:21:57.932613 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 16941
I20260809 23:21:57.932735 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786317539151495-1966-0/minicluster-data/master-2/wal/instance
I20260809 23:21:57.932928 1966 external_mini_cluster.cc:1428] Setting key 9f6b334de01de763c8e43811e19e635f
Aug 09 23:21:57 dist-test-slave-6nmv krb5kdc[16756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317717, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.188@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
Aug 09 23:21:57 dist-test-slave-6nmv krb5kdc[16756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317717, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.188@KRBTEST.COM
I20260809 23:21:57.940840 16849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.931669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34588 (local address 127.1.235.190:44447)
0809 23:21:57.931714 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:57.931715 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:57.931947 (+ 232us) server_negotiation.cc:407] Connection header received
0809 23:21:57.932417 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:57.932418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:57.932430 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:57.932471 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:57.933256 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.934017 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.935237 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.935429 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.935530 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.937837 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:57.937838 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:57.937838 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:57.937847 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:57.939442 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.939915 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.939917 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.939917 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.939976 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.940210 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.940211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.940211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.940338 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:57.940416 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:57.940675 (+ 259us) server_negotiation.cc:299] Negotiation successful
0809 23:21:57.940756 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 23:21:57.941082 17020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.931582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44447 (local address 127.0.0.1:34588)
0809 23:21:57.931837 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.931870 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:57.932308 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:57.932560 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:57.932563 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:57.932875 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:57.933143 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:57.933149 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.934102 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.934103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:57.935150 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:57.935152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.935551 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.935552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:57.935665 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.936159 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:57.936168 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:57.937733 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:57.939524 (+ 1791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:57.939532 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:57.939534 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:57.939817 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:57.940040 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:57.940041 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:57.940041 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:57.940146 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:57.940407 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:57.940414 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:57.940547 (+ 133us) client_negotiation.cc:769] Sending connection context
0809 23:21:57.940651 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 23:21:57.940789 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":141,"threads_started":1}
I20260809 23:21:57.941586 17018 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:21:57.941982 17023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.933347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49002 (local address 127.1.235.188:42671)
0809 23:21:57.933528 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:57.933531 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:57.933604 (+ 73us) server_negotiation.cc:407] Connection header received
0809 23:21:57.933681 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:57.933682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:57.933697 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:57.933754 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:57.934487 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.935434 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.936154 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.936595 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.936672 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.939237 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:57.939245 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:57.939245 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:57.939251 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:57.940748 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.941160 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.941163 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.941163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.941222 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.941409 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.941410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.941410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.941568 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:57.941707 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:57.941792 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 23:21:57.941882 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":98,"threads_started":1}
Aug 09 23:21:57 dist-test-slave-6nmv krb5kdc[16756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317717, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.188@KRBTEST.COM for kudu/127.1.235.189@KRBTEST.COM
Aug 09 23:21:57 dist-test-slave-6nmv krb5kdc[16756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317717, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:21:57.948752 17020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.941832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:33329 (local address 127.0.0.1:54576)
0809 23:21:57.941972 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.941982 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:57.942031 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:57.942367 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:57.942367 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:57.942473 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:57.942513 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:57.942514 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.943423 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.943424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:57.943884 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:57.943885 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.944257 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.944258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:57.944334 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.944722 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:57.944727 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:57.946070 (+ 1343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:57.947741 (+ 1671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:57.947742 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:57.947742 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:57.947916 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:57.948133 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:57.948134 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:57.948134 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:57.948194 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:57.948464 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:57.948465 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:57.948511 (+ 46us) client_negotiation.cc:769] Sending connection context
0809 23:21:57.948582 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 23:21:57.948669 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124}
I20260809 23:21:57.948761 16938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.941893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54576 (local address 127.1.235.189:33329)
0809 23:21:57.941963 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:57.941966 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:57.942018 (+ 52us) server_negotiation.cc:407] Connection header received
0809 23:21:57.942094 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:57.942095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:57.942105 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:57.942171 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:57.942694 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.943340 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.943969 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.944172 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.944256 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.946153 (+ 1897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:57.946154 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:57.946154 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:57.946161 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:57.947658 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.948004 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.948006 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.948006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.948064 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.948261 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.948262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.948262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.948390 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:57.948459 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:57.948608 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 23:21:57.948678 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 23:21:57.949366 17018 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:21:57.949980 16849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.943082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34596 (local address 127.1.235.190:44447)
0809 23:21:57.943119 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:57.943120 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:57.943129 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:21:57.943175 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:57.943176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:57.943186 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:57.943240 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:57.943702 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.944142 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.944783 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.944976 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.945043 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.947413 (+ 2370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:57.947414 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:57.947414 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:57.947420 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:57.948750 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.949160 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.949161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.949161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.949214 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.949436 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.949437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.949438 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.949555 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:57.949751 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:57.949784 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 23:21:57.949890 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
Aug 09 23:21:57 dist-test-slave-6nmv krb5kdc[16756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317717, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.188@KRBTEST.COM for kudu/127.1.235.188@KRBTEST.COM
Aug 09 23:21:57 dist-test-slave-6nmv krb5kdc[16756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317717, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.189@KRBTEST.COM
I20260809 23:21:57.956189 17020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.949652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42671 (local address 127.0.0.1:49008)
0809 23:21:57.949677 (+ 25us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.949685 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:57.949721 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:57.949888 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:57.949889 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:57.950038 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:57.950071 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:57.950073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.950908 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.950908 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:57.951331 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:57.951333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.951742 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.951742 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:57.951791 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.952175 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:57.952178 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:57.953251 (+ 1073us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:57.955087 (+ 1836us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:57.955088 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:57.955088 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:57.955249 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:57.955454 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:57.955455 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:57.955455 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:57.955519 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:57.955834 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:57.955835 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:57.955882 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 23:21:57.955969 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 23:21:57.956063 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13}
I20260809 23:21:57.956256 17023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.949679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49008 (local address 127.1.235.188:42671)
0809 23:21:57.949707 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:57.949708 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:57.949715 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:21:57.949771 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:57.949771 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:57.949779 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:57.949877 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:57.950137 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.950823 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.951429 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.951657 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.951740 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.953343 (+ 1603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:57.953344 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:57.953344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:57.953350 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:57.954981 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.955324 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.955325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.955325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.955390 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.955605 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.955606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.955606 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.955745 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:57.955813 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:57.955989 (+ 176us) server_negotiation.cc:299] Negotiation successful
0809 23:21:57.956109 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":17}
I20260809 23:21:57.957643 17018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9: Bootstrap starting.
I20260809 23:21:57.958323 16938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.950671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54588 (local address 127.1.235.189:33329)
0809 23:21:57.950703 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:57.950705 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:57.950712 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:21:57.950729 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:57.950730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:57.950737 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:57.950788 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:57.951268 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.951720 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.952546 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.952738 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.952811 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.955361 (+ 2550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:57.955363 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:57.955363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:57.955369 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:57.957057 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.957404 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.957405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.957406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.957479 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.957686 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.957686 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.957687 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.957891 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:57.958116 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:57.958158 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 23:21:57.958228 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 23:21:57.958670 17018 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9: Neither blocks nor log segments found. Creating new log.
I20260809 23:21:57.958999 17018 log.cc:824] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9: Log is configured to *not* fsync() on all Append() calls
I20260809 23:21:57.959797 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:21:57.959882 17018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9: No bootstrap required, opened a new log
I20260809 23:21:57.961762 17018 raft_consensus.cc:348] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } }
I20260809 23:21:57.961974 17018 raft_consensus.cc:374] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:21:57.962045 17018 raft_consensus.cc:729] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 314c4b282e854934a86d719e392c90f9, State: Initialized, Role: FOLLOWER
I20260809 23:21:57.962210 17018 consensus_queue.cc:260] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } }
I20260809 23:21:57.962553 17018 sys_catalog.cc:564] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:21:57.964983 17033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } } }
I20260809 23:21:57.965121 17033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 23:21:57.966727 17045 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 23:21:57.966825 17045 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:21:57.969496 16938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.961232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54600 (local address 127.1.235.189:33329)
0809 23:21:57.961263 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:57.961264 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:57.961501 (+ 237us) server_negotiation.cc:407] Connection header received
0809 23:21:57.961595 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:57.961596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:57.961605 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:57.961634 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:57.962387 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.963014 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.964100 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.964371 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.964420 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.966069 (+ 1649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:57.966071 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:57.966071 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:57.966079 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:57.967699 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.968101 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.968102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.968103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.968168 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.968355 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.968355 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.968355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.968469 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:57.969001 (+ 532us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:57.969333 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 23:21:57.969408 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 23:21:57.965255 16941 master_runner.cc:186] Error getting master registration for 127.1.235.190:44447: OK, instance_id { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" instance_seqno: 1786317717630903 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 23:21:57.969774 16941 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 23:21:57.970237 17023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.961347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49022 (local address 127.1.235.188:42671)
0809 23:21:57.961381 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:57.961382 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:57.961521 (+ 139us) server_negotiation.cc:407] Connection header received
0809 23:21:57.961605 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:57.961605 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:57.961614 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:57.961640 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:57.962386 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.963024 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.964016 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.964271 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.964324 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.966530 (+ 2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:57.966531 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:57.966532 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:57.966539 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:57.968783 (+ 2244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.969170 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.969171 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.969171 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.969224 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.969402 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.969403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.969403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.969543 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:57.969624 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:57.970048 (+ 424us) server_negotiation.cc:299] Negotiation successful
0809 23:21:57.970124 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 23:21:57.971112 16849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.961196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34608 (local address 127.1.235.190:44447)
0809 23:21:57.961290 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:57.961291 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:57.961461 (+ 170us) server_negotiation.cc:407] Connection header received
0809 23:21:57.961549 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:57.961550 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:57.961559 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:57.961583 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:57.962497 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.963120 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.964220 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.964460 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.964537 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.966153 (+ 1616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:57.966154 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:57.966155 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:57.966161 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:57.968040 (+ 1879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.970211 (+ 2171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.970212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.970212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.970279 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.970589 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.970590 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.970590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.970712 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:57.970812 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:57.971003 (+ 191us) server_negotiation.cc:299] Negotiation successful
0809 23:21:57.971056 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 23:21:57.972751 16846 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } attempt: 2
Aug 09 23:21:57 dist-test-slave-6nmv krb5kdc[16756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317717, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for kudu/127.1.235.188@KRBTEST.COM
I20260809 23:21:57.979712 17023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.973104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49024 (local address 127.1.235.188:42671)
0809 23:21:57.973166 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:57.973168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:57.973177 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:21:57.973227 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:57.973228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:57.973237 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:57.973303 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:57.973591 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.974130 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.974802 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.974991 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.975133 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.977050 (+ 1917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:57.977051 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:57.977051 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:57.977058 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:57.978424 (+ 1366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.978824 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.978825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.978825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.978908 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:57.979120 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:57.979122 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:57.979122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:57.979257 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:57.979344 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:57.979557 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 23:21:57.979625 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 23:21:57.979707 16848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:57.973019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42671 (local address 127.0.0.1:49024)
0809 23:21:57.973073 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:57.973084 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:57.973150 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:57.973307 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:57.973308 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:57.973475 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:57.973508 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:57.973510 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.974219 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.974220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:57.974699 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:57.974701 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:57.975135 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:57.975136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:57.975200 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:57.975620 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:57.975624 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:57.976952 (+ 1328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:57.978529 (+ 1577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:57.978530 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:57.978530 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:57.978736 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:57.978982 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:57.978983 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:57.978983 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:57.979052 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:57.979337 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:57.979338 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:57.979407 (+ 69us) client_negotiation.cc:769] Sending connection context
0809 23:21:57.979517 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 23:21:57.979612 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 23:21:57.981216 16846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c: Bootstrap starting.
I20260809 23:21:57.981964 16846 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c: Neither blocks nor log segments found. Creating new log.
I20260809 23:21:57.982268 16846 log.cc:824] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c: Log is configured to *not* fsync() on all Append() calls
I20260809 23:21:57.983131 16846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c: No bootstrap required, opened a new log
I20260809 23:21:57.984634 16846 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } }
I20260809 23:21:57.984735 16846 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:21:57.984756 16846 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc17a83d7c2a43ad99f6e7e08b870c0c, State: Initialized, Role: FOLLOWER
I20260809 23:21:57.984889 16846 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } }
I20260809 23:21:57.985164 17048 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } } }
I20260809 23:21:57.985220 16846 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:21:57.985267 17048 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c [sys.catalog]: This master's current role is: FOLLOWER
W20260809 23:21:57.987147 17061 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 23:21:57.987252 17061 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:21:57.988051 16769 master_runner.cc:186] Error getting master registration for 127.1.235.189:33329: OK, instance_id { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" instance_seqno: 1786317717771734 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 23:21:57.990794 16769 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 23:21:58.001597 17033 raft_consensus.cc:482] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:21:58.001700 17033 raft_consensus.cc:504] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } }
I20260809 23:21:58.001989 17033 leader_election.cc:288] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc17a83d7c2a43ad99f6e7e08b870c0c (127.1.235.190:44447), 67b5c7cdb7874320ae0d776341f2ce99 (127.1.235.189:33329)
I20260809 23:21:58.002278 16819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "314c4b282e854934a86d719e392c90f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" is_pre_election: true
I20260809 23:21:58.002408 16819 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 314c4b282e854934a86d719e392c90f9 in term 0.
I20260809 23:21:58.002599 16963 leader_election.cc:302] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314c4b282e854934a86d719e392c90f9, cc17a83d7c2a43ad99f6e7e08b870c0c; no voters:
I20260809 23:21:58.002710 17033 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:21:58.002748 17033 raft_consensus.cc:482] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:21:58.002769 17033 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:21:58.003590 17033 raft_consensus.cc:504] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } }
I20260809 23:21:58.003700 17033 leader_election.cc:288] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [CANDIDATE]: Term 1 election: Requested vote from peers cc17a83d7c2a43ad99f6e7e08b870c0c (127.1.235.190:44447), 67b5c7cdb7874320ae0d776341f2ce99 (127.1.235.189:33329)
I20260809 23:21:58.003850 16819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "314c4b282e854934a86d719e392c90f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c"
I20260809 23:21:58.003923 16819 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:21:58.004670 16819 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314c4b282e854934a86d719e392c90f9 in term 1.
I20260809 23:21:58.004835 16963 leader_election.cc:302] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 314c4b282e854934a86d719e392c90f9, cc17a83d7c2a43ad99f6e7e08b870c0c; no voters:
I20260809 23:21:58.004952 17033 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:21:58.005126 17033 raft_consensus.cc:686] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [term 1 LEADER]: Becoming Leader. State: Replica: 314c4b282e854934a86d719e392c90f9, State: Running, Role: LEADER
I20260809 23:21:58.005219 17033 consensus_queue.cc:237] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } }
I20260809 23:21:58.005612 17063 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 314c4b282e854934a86d719e392c90f9. Latest consensus state: current_term: 1 leader_uuid: "314c4b282e854934a86d719e392c90f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } } }
I20260809 23:21:58.005877 17063 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [sys.catalog]: This master's current role is: LEADER
I20260809 23:21:58.006392 17065 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:21:58.006739 17065 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:21:58.007197 16934 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } attempt: 3
I20260809 23:21:58.009392 16819 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c [term 1 FOLLOWER]: Refusing update from remote peer 314c4b282e854934a86d719e392c90f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:21:58.009835 17063 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:21:58.011126 17048 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 314c4b282e854934a86d719e392c90f9. Latest consensus state: current_term: 1 leader_uuid: "314c4b282e854934a86d719e392c90f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } } }
I20260809 23:21:58.011209 17048 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c [sys.catalog]: This master's current role is: FOLLOWER
Aug 09 23:21:58 dist-test-slave-6nmv krb5kdc[16756](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317717, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.189@KRBTEST.COM for kudu/127.1.235.188@KRBTEST.COM
I20260809 23:21:58.015144 16936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:58.007400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:42671 (local address 127.0.0.1:49028)
0809 23:21:58.007436 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 23:21:58.007447 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:21:58.007486 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:21:58.007638 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:21:58.007639 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:21:58.007805 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:21:58.007847 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:58.007848 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:58.008728 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:58.008729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:58.009454 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:21:58.009456 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:21:58.009959 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:21:58.009960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:21:58.010010 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:58.010430 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:21:58.010435 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:21:58.011812 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:21:58.013996 (+ 2184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:58.013997 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:58.013998 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:58.014199 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:58.014416 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:21:58.014417 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:21:58.014417 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:21:58.014479 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:21:58.014812 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:21:58.014813 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:21:58.014856 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 23:21:58.014932 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 23:21:58.015036 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260809 23:21:58.015487 17023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:21:58.007476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49028 (local address 127.1.235.188:42671)
0809 23:21:58.007509 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 23:21:58.007511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:21:58.007518 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:21:58.007536 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:21:58.007537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:21:58.007544 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:21:58.007583 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:21:58.007921 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:58.008612 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:58.009535 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:21:58.009801 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:21:58.009870 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:21:58.011913 (+ 2043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:21:58.011914 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:21:58.011915 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:21:58.011921 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:21:58.013895 (+ 1974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:58.014280 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:58.014281 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:58.014282 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:58.014341 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:21:58.014574 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:21:58.014575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:21:58.014575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:21:58.014710 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:21:58.014768 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 23:21:58.015322 (+ 554us) server_negotiation.cc:299] Negotiation successful
0809 23:21:58.015402 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 23:21:58.016990 16934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99: Bootstrap starting.
I20260809 23:21:58.017037 17033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "314c4b282e854934a86d719e392c90f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } } }
I20260809 23:21:58.017112 17033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [sys.catalog]: This master's current role is: LEADER
I20260809 23:21:58.017405 17048 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "314c4b282e854934a86d719e392c90f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } } }
I20260809 23:21:58.017473 17048 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c [sys.catalog]: This master's current role is: FOLLOWER
I20260809 23:21:58.017625 16934 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99: Neither blocks nor log segments found. Creating new log.
I20260809 23:21:58.017970 16934 log.cc:824] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99: Log is configured to *not* fsync() on all Append() calls
I20260809 23:21:58.018509 17066 mvcc.cc:205] Tried to move back new op lower bound from 7316757372962623488 to 7316757372949966848. Current Snapshot: MvccSnapshot[applied={T|T < 7316757372962623488}]
I20260809 23:21:58.018790 17067 mvcc.cc:205] Tried to move back new op lower bound from 7316757372962623488 to 7316757372949966848. Current Snapshot: MvccSnapshot[applied={T|T < 7316757372962623488}]
I20260809 23:21:58.019529 16934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99: No bootstrap required, opened a new log
I20260809 23:21:58.020572 17065 catalog_manager.cc:1347] Generated new cluster ID: e7b6115db6024957b04003ae1c5b9fe3
I20260809 23:21:58.020637 17065 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:21:58.021426 16934 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } }
I20260809 23:21:58.021548 16934 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:21:58.021590 16934 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67b5c7cdb7874320ae0d776341f2ce99, State: Initialized, Role: FOLLOWER
I20260809 23:21:58.021685 16934 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } }
I20260809 23:21:58.022048 16934 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 23:21:58.023685 17085 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 23:21:58.023726 17085 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:21:58.023833 17072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } } }
I20260809 23:21:58.023883 17072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 23:21:58.024385 16902 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:21:58.025265 16902 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99 [term 1 FOLLOWER]: Refusing update from remote peer 314c4b282e854934a86d719e392c90f9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:21:58.025427 16904 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "314c4b282e854934a86d719e392c90f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67b5c7cdb7874320ae0d776341f2ce99" is_pre_election: true
I20260809 23:21:58.025533 16904 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 314c4b282e854934a86d719e392c90f9 in term 1.
I20260809 23:21:58.025993 16903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "314c4b282e854934a86d719e392c90f9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67b5c7cdb7874320ae0d776341f2ce99"
I20260809 23:21:58.026751 16903 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 314c4b282e854934a86d719e392c90f9 in term 1.
I20260809 23:21:58.027179 17063 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:21:58.034794 17072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 314c4b282e854934a86d719e392c90f9. Latest consensus state: current_term: 1 leader_uuid: "314c4b282e854934a86d719e392c90f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } } }
I20260809 23:21:58.034906 17072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 23:21:58.034943 17072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "314c4b282e854934a86d719e392c90f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } } }
I20260809 23:21:58.034982 17072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 23:21:58.040678 17087 mvcc.cc:205] Tried to move back new op lower bound from 7316757372962623488 to 7316757372949966848. Current Snapshot: MvccSnapshot[applied={T|T < 7316757372962623488}]
I20260809 23:21:58.041164 17063 sys_catalog.cc:455] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "314c4b282e854934a86d719e392c90f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc17a83d7c2a43ad99f6e7e08b870c0c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44447 } } peers { permanent_uuid: "67b5c7cdb7874320ae0d776341f2ce99" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 33329 } } peers { permanent_uuid: "314c4b282e854934a86d719e392c90f9" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 42671 } } }
I20260809 23:21:58.041242 17063 sys_catalog.cc:458] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9 [sys.catalog]: This master's current role is: LEADER
I20260809 23:21:58.043519 17065 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:21:58.044265 17065 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:21:58.050621 17065 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 314c4b282e854934a86d719e392c90f9: Generated new TSK 0
I20260809 23:21:58.050838 17065 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:21:58.987655 17061 catalog_manager.cc:1259] Loaded cluster ID: e7b6115db6024957b04003ae1c5b9fe3
I20260809 23:21:58.987715 17061 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c: loading cluster ID for follower catalog manager: success
I20260809 23:21:58.988523 17061 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c: acquiring CA information for follower catalog manager: success
I20260809 23:21:58.988837 17061 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cc17a83d7c2a43ad99f6e7e08b870c0c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 23:21:59.024116 17085 catalog_manager.cc:1259] Loaded cluster ID: e7b6115db6024957b04003ae1c5b9fe3
I20260809 23:21:59.024210 17085 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99: loading cluster ID for follower catalog manager: success
I20260809 23:21:59.025027 17085 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99: acquiring CA information for follower catalog manager: success
I20260809 23:21:59.025373 17085 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 67b5c7cdb7874320ae0d776341f2ce99: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 23:21:59.106645 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 16769
I20260809 23:21:59.114152 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 16854
W20260809 23:21:59.120184 16965 connection.cc:535] client connection to 127.1.235.189:33329 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260809 23:21:59.120312 16965 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 23:21:59.120427 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 16941
2026-08-09T23:21:59Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2754 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:21:59 dist-test-slave-6nmv krb5kdc[17103](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:21:59 dist-test-slave-6nmv krb5kdc[17103](info): set up 2 sockets
Aug 09 23:21:59 dist-test-slave-6nmv krb5kdc[17103](info): commencing operation
krb5kdc: starting...
W20260809 23:22:00.148458 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.007s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:22:00 dist-test-slave-6nmv krb5kdc[17103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:22:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:22:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:22:00.269223 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:44241
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:46491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:44241
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:22:00.348663 17118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:00.348843 17118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:00.348865 17118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:00.350023 17118 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:22:00.350064 17118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:00.350078 17118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:00.350116 17118 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:22:00.350147 17118 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:22:00.351603 17118 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:46491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:44241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:44241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17118
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:00.351856 17118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:00.352109 17118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:00.356876 17124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:00.356855 17125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:00.357069 17118 server_base.cc:1034] running on GCE node
W20260809 23:22:00.356869 17127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:00.357445 17118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:00.357776 17118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:00.358968 17118 hybrid_clock.cc:648] HybridClock initialized: now 1786317720358954 us; error 30 us; skew 500 ppm
Aug 09 23:22:00 dist-test-slave-6nmv krb5kdc[17103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317720, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:00.361665 17118 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:22:00.362142 17118 webserver.cc:460] Webserver started at http://127.1.235.190:36755/ using document root <none> and password file <none>
I20260809 23:22:00.362386 17118 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:00.362459 17118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:00.362615 17118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:22:00.363723 17118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "c390f3997e664b45a50790621ab75603"
format_stamp: "Formatted at 2026-08-09 23:22:00 on dist-test-slave-6nmv"
server_key: "3c93a8d4529456821d2344369dc9b5ef"
server_key_iv: "bb311e095d0ecfff80513ed8f2f67281"
server_key_version: "encryptionkey@0"
I20260809 23:22:00.364077 17118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "c390f3997e664b45a50790621ab75603"
format_stamp: "Formatted at 2026-08-09 23:22:00 on dist-test-slave-6nmv"
server_key: "3c93a8d4529456821d2344369dc9b5ef"
server_key_iv: "bb311e095d0ecfff80513ed8f2f67281"
server_key_version: "encryptionkey@0"
I20260809 23:22:00.365394 17118 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 23:22:00.366187 17134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:00.366360 17118 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:22:00.366470 17118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "c390f3997e664b45a50790621ab75603"
format_stamp: "Formatted at 2026-08-09 23:22:00 on dist-test-slave-6nmv"
server_key: "3c93a8d4529456821d2344369dc9b5ef"
server_key_iv: "bb311e095d0ecfff80513ed8f2f67281"
server_key_version: "encryptionkey@0"
I20260809 23:22:00.366545 17118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:00.373101 17118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:00.375131 17118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:00.375288 17118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:00.379141 17118 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:44241
I20260809 23:22:00.379207 17190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:44241 every 8 connection(s)
I20260809 23:22:00.379544 17118 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:22:00.380383 17191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:22:00.382637 17191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603: Bootstrap starting.
I20260809 23:22:00.383215 17191 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603: Neither blocks nor log segments found. Creating new log.
I20260809 23:22:00.383509 17191 log.cc:824] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:00.383739 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 17118
I20260809 23:22:00.383857 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:22:00.384055 1966 external_mini_cluster.cc:1428] Setting key 16b982fe78be7ca837096e1cb7e39fc5
I20260809 23:22:00.384248 17191 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603: No bootstrap required, opened a new log
I20260809 23:22:00.386080 17191 raft_consensus.cc:348] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c390f3997e664b45a50790621ab75603" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44241 } }
I20260809 23:22:00.386232 17191 raft_consensus.cc:374] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:22:00.386277 17191 raft_consensus.cc:729] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c390f3997e664b45a50790621ab75603, State: Initialized, Role: FOLLOWER
I20260809 23:22:00.386407 17191 consensus_queue.cc:260] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c390f3997e664b45a50790621ab75603" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44241 } }
I20260809 23:22:00.386492 17191 raft_consensus.cc:388] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:22:00.386538 17191 raft_consensus.cc:482] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:22:00.386584 17191 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:22:00.387422 17191 raft_consensus.cc:504] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c390f3997e664b45a50790621ab75603" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44241 } }
I20260809 23:22:00.387539 17191 leader_election.cc:302] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c390f3997e664b45a50790621ab75603; no voters:
I20260809 23:22:00.387724 17191 leader_election.cc:288] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:22:00.387809 17196 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:22:00.387950 17196 raft_consensus.cc:686] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [term 1 LEADER]: Becoming Leader. State: Replica: c390f3997e664b45a50790621ab75603, State: Running, Role: LEADER
I20260809 23:22:00.388013 17191 sys_catalog.cc:564] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:22:00.388031 17196 consensus_queue.cc:237] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c390f3997e664b45a50790621ab75603" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44241 } }
I20260809 23:22:00.388321 17196 sys_catalog.cc:455] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c390f3997e664b45a50790621ab75603. Latest consensus state: current_term: 1 leader_uuid: "c390f3997e664b45a50790621ab75603" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c390f3997e664b45a50790621ab75603" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44241 } } }
I20260809 23:22:00.388331 17198 sys_catalog.cc:455] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c390f3997e664b45a50790621ab75603" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c390f3997e664b45a50790621ab75603" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44241 } } }
I20260809 23:22:00.388402 17196 sys_catalog.cc:458] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [sys.catalog]: This master's current role is: LEADER
I20260809 23:22:00.388437 17198 sys_catalog.cc:458] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603 [sys.catalog]: This master's current role is: LEADER
I20260809 23:22:00.389243 17201 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:22:00.389776 17201 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 09 23:22:00 dist-test-slave-6nmv krb5kdc[17103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317720, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:22:00.394209 17201 catalog_manager.cc:1347] Generated new cluster ID: 73e9e617499846d38833f4ef8574df79
I20260809 23:22:00.394282 17201 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:22:00.396086 17195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:00.384574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46566 (local address 127.1.235.190:44241)
0809 23:22:00.384737 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:00.384747 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:00.384781 (+ 34us) server_negotiation.cc:407] Connection header received
0809 23:22:00.386051 (+ 1270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:00.386057 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:00.386106 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:00.386251 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:00.387024 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:00.388347 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:00.389333 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:00.389893 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:00.390026 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:00.392600 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:00.392604 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:00.392604 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:00.392615 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:00.394496 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:00.394862 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:00.394864 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:00.394865 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:00.394979 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:00.395193 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:00.395194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:00.395195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:00.395432 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:00.395589 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:00.395707 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 23:22:00.395944 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":76,"threads_started":1}
I20260809 23:22:00.396915 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:22:00.406349 17201 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:22:00.407053 17201 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:22:00.414326 17201 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c390f3997e664b45a50790621ab75603: Generated new TSK 0
I20260809 23:22:00.414492 17201 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:22:00.450562 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 17118
2026-08-09T23:22:00Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1330 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:22:00 dist-test-slave-6nmv krb5kdc[17218](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:22:00 dist-test-slave-6nmv krb5kdc[17218](info): set up 2 sockets
Aug 09 23:22:00 dist-test-slave-6nmv krb5kdc[17218](info): commencing operation
krb5kdc: starting...
W20260809 23:22:01.463374 1966 mini_kdc.cc:121] Time spent starting KDC: real 0.991s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:22:01 dist-test-slave-6nmv krb5kdc[17218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:22:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:22:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:22:01.570830 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:39419
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:39419
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:22:01.645731 17232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:01.645931 17232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:01.645953 17232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:01.646975 17232 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:22:01.647004 17232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:01.647017 17232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:01.647029 17232 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:22:01.647040 17232 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:22:01.648310 17232 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:39419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:39419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:01.648463 17232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:01.648612 17232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:01.653041 17239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:01.653088 17242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:01.653051 17238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:01.653241 17232 server_base.cc:1034] running on GCE node
I20260809 23:22:01.653463 17232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:01.653712 17232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:01.654861 17232 hybrid_clock.cc:648] HybridClock initialized: now 1786317721654854 us; error 46 us; skew 500 ppm
Aug 09 23:22:01 dist-test-slave-6nmv krb5kdc[17218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317721, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:01.657246 17232 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:22:01.657687 17232 webserver.cc:460] Webserver started at http://127.1.235.190:39075/ using document root <none> and password file <none>
I20260809 23:22:01.657953 17232 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:01.658018 17232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:01.658149 17232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:22:01.659034 17232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "4065be1872104ddbb008d818e955c8fa"
format_stamp: "Formatted at 2026-08-09 23:22:01 on dist-test-slave-6nmv"
server_key: "9ce606a3b00878f42592b16b5d0c4428"
server_key_iv: "b701c52623cd8bf743c39f6fd6090c1f"
server_key_version: "encryptionkey@0"
I20260809 23:22:01.659349 17232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "4065be1872104ddbb008d818e955c8fa"
format_stamp: "Formatted at 2026-08-09 23:22:01 on dist-test-slave-6nmv"
server_key: "9ce606a3b00878f42592b16b5d0c4428"
server_key_iv: "b701c52623cd8bf743c39f6fd6090c1f"
server_key_version: "encryptionkey@0"
I20260809 23:22:01.660576 17232 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:22:01.661206 17249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:01.661367 17232 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:22:01.661459 17232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "4065be1872104ddbb008d818e955c8fa"
format_stamp: "Formatted at 2026-08-09 23:22:01 on dist-test-slave-6nmv"
server_key: "9ce606a3b00878f42592b16b5d0c4428"
server_key_iv: "b701c52623cd8bf743c39f6fd6090c1f"
server_key_version: "encryptionkey@0"
I20260809 23:22:01.661545 17232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:01.676496 17232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:01.678182 17232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:01.678326 17232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:01.681929 17232 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:39419
I20260809 23:22:01.681979 17305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:39419 every 8 connection(s)
I20260809 23:22:01.682232 17232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:22:01.683056 17306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:22:01.685007 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 17232
I20260809 23:22:01.685123 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:22:01.685155 17306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa: Bootstrap starting.
I20260809 23:22:01.685302 1966 external_mini_cluster.cc:1428] Setting key b6cc2c899a2252de0fb89b4177266e02
I20260809 23:22:01.685845 17306 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa: Neither blocks nor log segments found. Creating new log.
I20260809 23:22:01.686154 17306 log.cc:824] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:01.686862 17306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa: No bootstrap required, opened a new log
I20260809 23:22:01.688479 17306 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } }
I20260809 23:22:01.688614 17306 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:22:01.688659 17306 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4065be1872104ddbb008d818e955c8fa, State: Initialized, Role: FOLLOWER
I20260809 23:22:01.688822 17306 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } }
I20260809 23:22:01.688933 17306 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:22:01.688977 17306 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:22:01.689024 17306 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:22:01.689550 17306 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } }
I20260809 23:22:01.689648 17306 leader_election.cc:302] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4065be1872104ddbb008d818e955c8fa; no voters:
I20260809 23:22:01.689792 17306 leader_election.cc:288] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:22:01.689842 17312 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:22:01.690097 17312 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 1 LEADER]: Becoming Leader. State: Replica: 4065be1872104ddbb008d818e955c8fa, State: Running, Role: LEADER
I20260809 23:22:01.690183 17312 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } }
I20260809 23:22:01.690332 17306 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:22:01.691392 17313 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4065be1872104ddbb008d818e955c8fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } } }
I20260809 23:22:01.691468 17313 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [sys.catalog]: This master's current role is: LEADER
I20260809 23:22:01.691462 17315 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4065be1872104ddbb008d818e955c8fa. Latest consensus state: current_term: 1 leader_uuid: "4065be1872104ddbb008d818e955c8fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } } }
I20260809 23:22:01.691545 17315 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [sys.catalog]: This master's current role is: LEADER
I20260809 23:22:01.691748 17328 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 09 23:22:01 dist-test-slave-6nmv krb5kdc[17218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317721, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:22:01.692221 17328 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:22:01.693835 17328 catalog_manager.cc:1347] Generated new cluster ID: 4702505dbd874d7ab403df70d8363e7a
I20260809 23:22:01.693884 17328 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:22:01.695982 17310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:01.685847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35416 (local address 127.1.235.190:39419)
0809 23:22:01.686045 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:01.686055 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:01.686085 (+ 30us) server_negotiation.cc:407] Connection header received
0809 23:22:01.686722 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:01.686728 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:01.686771 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:01.686924 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:01.687492 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:01.688255 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:01.689154 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:01.689616 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:01.689722 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:01.692431 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:01.692435 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:01.692435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:01.692446 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:01.694476 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:01.694821 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:01.694823 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:01.694823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:01.694926 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:01.695105 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:01.695106 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:01.695106 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:01.695362 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:01.695532 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:01.695622 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 23:22:01.695756 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":77,"threads_started":1}
I20260809 23:22:01.707067 17328 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:22:01.707476 17328 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:22:01.710716 17328 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa: Generated new TSK 0
I20260809 23:22:01.710844 17328 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:22:01.742645 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39419
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:22:01.822909 17339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:01.823129 17339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:01.823153 17339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:01.824252 17339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:01.824296 17339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:01.824323 17339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:22:01.825973 17339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:01.826237 17339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:01.826551 17339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:01.831364 17347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:01.831437 17339 server_base.cc:1034] running on GCE node
W20260809 23:22:01.831395 17345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:01.831398 17349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:01.831729 17339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:01.831972 17339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:01.833124 17339 hybrid_clock.cc:648] HybridClock initialized: now 1786317721833109 us; error 43 us; skew 500 ppm
Aug 09 23:22:01 dist-test-slave-6nmv krb5kdc[17218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317721, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:01.835391 17339 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:22:01.835861 17339 webserver.cc:460] Webserver started at http://127.1.235.129:45387/ using document root <none> and password file <none>
I20260809 23:22:01.836104 17339 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:01.836172 17339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:01.836326 17339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:22:01.837272 17339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "ca774ea32fdf4ea1b731ae428c29db75"
format_stamp: "Formatted at 2026-08-09 23:22:01 on dist-test-slave-6nmv"
server_key: "05ad13c00b63dca5dc4867e707aa90af"
server_key_iv: "974da1b661a4b2a74389d1aa4755234c"
server_key_version: "encryptionkey@0"
I20260809 23:22:01.837594 17339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "ca774ea32fdf4ea1b731ae428c29db75"
format_stamp: "Formatted at 2026-08-09 23:22:01 on dist-test-slave-6nmv"
server_key: "05ad13c00b63dca5dc4867e707aa90af"
server_key_iv: "974da1b661a4b2a74389d1aa4755234c"
server_key_version: "encryptionkey@0"
I20260809 23:22:01.838856 17339 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:22:01.839526 17356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:01.839699 17339 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:22:01.839785 17339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "ca774ea32fdf4ea1b731ae428c29db75"
format_stamp: "Formatted at 2026-08-09 23:22:01 on dist-test-slave-6nmv"
server_key: "05ad13c00b63dca5dc4867e707aa90af"
server_key_iv: "974da1b661a4b2a74389d1aa4755234c"
server_key_version: "encryptionkey@0"
I20260809 23:22:01.839864 17339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:01.861123 17339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:01.863194 17339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:01.863359 17339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:01.863569 17339 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:22:01.863852 17339 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:22:01.863911 17339 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:01.863947 17339 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:22:01.863970 17339 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:01.869700 17339 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:37697
I20260809 23:22:01.869747 17481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:37697 every 8 connection(s)
I20260809 23:22:01.870028 17339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
Aug 09 23:22:01 dist-test-slave-6nmv krb5kdc[17218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317721, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:22:01.877152 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 17339
I20260809 23:22:01.877288 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:22:01.877509 1966 external_mini_cluster.cc:1428] Setting key 2f8739ea2149f68ff6624dcd2d80ba85
I20260809 23:22:01.879204 17486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:01.870651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:40957)
0809 23:22:01.870818 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:01.870846 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:01.871259 (+ 413us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:01.871511 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:01.871514 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:01.872037 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:22:01.872202 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:01.872206 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:01.872910 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:01.872911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:01.873633 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:01.873635 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:01.874128 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:01.874129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:01.874241 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:01.874709 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:22:01.874716 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:22:01.876120 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:22:01.877855 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:01.877862 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:01.877864 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:01.878108 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:01.878324 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:01.878324 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:01.878325 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:01.878443 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:01.878730 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:22:01.878734 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:22:01.878830 (+ 96us) client_negotiation.cc:769] Sending connection context
0809 23:22:01.878937 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 23:22:01.879048 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":95,"threads_started":1}
I20260809 23:22:01.879220 17310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:01.870664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:40957 (local address 127.1.235.190:39419)
0809 23:22:01.870738 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:01.870739 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:01.870924 (+ 185us) server_negotiation.cc:407] Connection header received
0809 23:22:01.871357 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:01.871358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:01.871370 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:01.871446 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:01.872302 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:01.872797 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:01.873726 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:01.874032 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:01.874116 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:01.876213 (+ 2097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:01.876214 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:01.876214 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:01.876221 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:01.877749 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:01.878185 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:01.878187 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:01.878187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:01.878250 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:01.878517 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:01.878518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:01.878518 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:01.878668 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:01.878733 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:01.878982 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 23:22:01.879074 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 23:22:01.879881 17484 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39419
I20260809 23:22:01.879984 17484 heartbeater.cc:464] Registering TS with master...
I20260809 23:22:01.880198 17484 heartbeater.cc:511] Master 127.1.235.190:39419 requested a full tablet report, sending...
I20260809 23:22:01.880780 17268 ts_manager.cc:194] Registered new tserver with Master: ca774ea32fdf4ea1b731ae428c29db75 (127.1.235.129:37697)
I20260809 23:22:01.881583 17268 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:40957
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:22:01.904516 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39419
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:22:01.977329 17490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:01.977511 17490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:01.977545 17490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:01.978531 17490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:01.978590 17490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:01.978641 17490 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:22:01.979945 17490 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:01.980190 17490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:01.980384 17490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 23:22:01.984815 17490 server_base.cc:1034] running on GCE node
W20260809 23:22:01.984846 17495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:01.984788 17499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:01.984779 17497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:01.985150 17490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:01.985376 17490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:01.986514 17490 hybrid_clock.cc:648] HybridClock initialized: now 1786317721986507 us; error 31 us; skew 500 ppm
Aug 09 23:22:01 dist-test-slave-6nmv krb5kdc[17218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317721, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:01.988909 17490 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:22:01.989353 17490 webserver.cc:460] Webserver started at http://127.1.235.130:43665/ using document root <none> and password file <none>
I20260809 23:22:01.989578 17490 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:01.989645 17490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:01.989876 17490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:22:01.990981 17490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "3b993b0a2ee8427baa3e952bece61404"
format_stamp: "Formatted at 2026-08-09 23:22:01 on dist-test-slave-6nmv"
server_key: "7f56faa63bed90b9c10a3f3e4c92ad23"
server_key_iv: "62499ff38d352fa9a2eda61e3a2a53d6"
server_key_version: "encryptionkey@0"
I20260809 23:22:01.991321 17490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "3b993b0a2ee8427baa3e952bece61404"
format_stamp: "Formatted at 2026-08-09 23:22:01 on dist-test-slave-6nmv"
server_key: "7f56faa63bed90b9c10a3f3e4c92ad23"
server_key_iv: "62499ff38d352fa9a2eda61e3a2a53d6"
server_key_version: "encryptionkey@0"
I20260809 23:22:01.992609 17490 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:22:01.993287 17508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:01.993466 17490 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:22:01.993554 17490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "3b993b0a2ee8427baa3e952bece61404"
format_stamp: "Formatted at 2026-08-09 23:22:01 on dist-test-slave-6nmv"
server_key: "7f56faa63bed90b9c10a3f3e4c92ad23"
server_key_iv: "62499ff38d352fa9a2eda61e3a2a53d6"
server_key_version: "encryptionkey@0"
I20260809 23:22:01.993633 17490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:02.017431 17490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:02.019191 17490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:02.019356 17490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:02.019556 17490 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:22:02.019840 17490 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:22:02.019893 17490 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:02.019925 17490 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:22:02.019953 17490 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:02.025547 17490 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:35417
I20260809 23:22:02.025606 17627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:35417 every 8 connection(s)
I20260809 23:22:02.025897 17490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:22:02.028885 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 17490
I20260809 23:22:02.028997 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:22:02.029186 1966 external_mini_cluster.cc:1428] Setting key 557cd08c11c7ba93eb20151466b88709
Aug 09 23:22:02 dist-test-slave-6nmv krb5kdc[17218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317721, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:22:02.036140 17310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.026594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:52475 (local address 127.1.235.190:39419)
0809 23:22:02.026662 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:02.026663 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:02.026833 (+ 170us) server_negotiation.cc:407] Connection header received
0809 23:22:02.027280 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:02.027280 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:02.027289 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:02.027339 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:02.028259 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.029073 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.030609 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.030910 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.030986 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.033160 (+ 2174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:02.033162 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:02.033162 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:02.033169 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:02.034736 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:02.035130 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:02.035131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:02.035132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:02.035185 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:02.035445 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:02.035446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:02.035446 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:02.035579 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:02.035658 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:02.035938 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 23:22:02.036048 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 23:22:02.036273 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.026549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:52475)
0809 23:22:02.026717 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:02.026755 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:02.027205 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:02.027402 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:02.027405 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:02.027916 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:22:02.028142 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.028149 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.029199 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.029200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.030515 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.030519 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.031003 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.031004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.031169 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.031660 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:22:02.031668 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:22:02.033070 (+ 1402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:22:02.034814 (+ 1744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:02.034821 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:02.034823 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:02.035057 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:02.035257 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:02.035258 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:02.035258 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:02.035366 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:02.035649 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:22:02.035655 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:22:02.035791 (+ 136us) client_negotiation.cc:769] Sending connection context
0809 23:22:02.035911 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 23:22:02.036063 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":90,"threads_started":1}
I20260809 23:22:02.036733 17631 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39419
I20260809 23:22:02.036826 17631 heartbeater.cc:464] Registering TS with master...
I20260809 23:22:02.037009 17631 heartbeater.cc:511] Master 127.1.235.190:39419 requested a full tablet report, sending...
I20260809 23:22:02.037416 17268 ts_manager.cc:194] Registered new tserver with Master: 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417)
I20260809 23:22:02.037797 17268 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:52475
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:22:02.054584 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39419
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:22:02.144964 17636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:02.145153 17636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:02.145185 17636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:02.146332 17636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:02.146392 17636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:02.146440 17636 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:22:02.147790 17636 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:39419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17636
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:02.148036 17636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:02.148243 17636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:02.152576 17642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:02.152591 17644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:02.152612 17636 server_base.cc:1034] running on GCE node
W20260809 23:22:02.152585 17641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:02.152945 17636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:02.153155 17636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:02.154297 17636 hybrid_clock.cc:648] HybridClock initialized: now 1786317722154287 us; error 26 us; skew 500 ppm
Aug 09 23:22:02 dist-test-slave-6nmv krb5kdc[17218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317722, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:02.156810 17636 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:22:02.157171 17636 webserver.cc:460] Webserver started at http://127.1.235.131:36661/ using document root <none> and password file <none>
I20260809 23:22:02.157326 17636 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:02.157362 17636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:02.157480 17636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:22:02.158488 17636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "27b74a856b4449e2af5b7b04f77af46c"
format_stamp: "Formatted at 2026-08-09 23:22:02 on dist-test-slave-6nmv"
server_key: "ca063fcbd89f99af20e5755e3c4bf849"
server_key_iv: "667e32d12705f62b183ad28fb3befb48"
server_key_version: "encryptionkey@0"
I20260809 23:22:02.158777 17636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "27b74a856b4449e2af5b7b04f77af46c"
format_stamp: "Formatted at 2026-08-09 23:22:02 on dist-test-slave-6nmv"
server_key: "ca063fcbd89f99af20e5755e3c4bf849"
server_key_iv: "667e32d12705f62b183ad28fb3befb48"
server_key_version: "encryptionkey@0"
I20260809 23:22:02.159922 17636 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:22:02.160575 17652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:02.160740 17636 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:22:02.160836 17636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "27b74a856b4449e2af5b7b04f77af46c"
format_stamp: "Formatted at 2026-08-09 23:22:02 on dist-test-slave-6nmv"
server_key: "ca063fcbd89f99af20e5755e3c4bf849"
server_key_iv: "667e32d12705f62b183ad28fb3befb48"
server_key_version: "encryptionkey@0"
I20260809 23:22:02.160930 17636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:02.187866 17636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:02.189507 17636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:02.189689 17636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:02.189971 17636 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:22:02.190205 17636 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:22:02.190234 17636 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:02.190253 17636 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:22:02.190264 17636 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:02.196084 17636 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:44575
I20260809 23:22:02.196110 17775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:44575 every 8 connection(s)
I20260809 23:22:02.196439 17636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:22:02.199071 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 17636
I20260809 23:22:02.199158 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:22:02.199314 1966 external_mini_cluster.cc:1428] Setting key e02c15e1f2b5b3850acf5f741661d263
Aug 09 23:22:02 dist-test-slave-6nmv krb5kdc[17218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317722, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:22:02.205169 17310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.197181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:41149 (local address 127.1.235.190:39419)
0809 23:22:02.197225 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:02.197228 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:02.197460 (+ 232us) server_negotiation.cc:407] Connection header received
0809 23:22:02.197932 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:02.197933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:02.197943 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:02.197997 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:02.198814 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.199500 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.200604 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.200773 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.200824 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.202682 (+ 1858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:02.202683 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:02.202683 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:02.202689 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:02.204091 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:02.204434 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:02.204434 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:02.204435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:02.204490 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:02.204678 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:02.204679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:02.204679 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:02.204765 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:02.204810 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:02.205055 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 23:22:02.205111 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:22:02.205335 17778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.197173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:41149)
0809 23:22:02.197329 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:02.197360 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:02.197805 (+ 445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:02.198046 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:02.198049 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:02.198548 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:22:02.198743 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.198747 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.199573 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.199573 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.200535 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.200537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.200840 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.200841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.200927 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.201300 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:22:02.201307 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:22:02.202603 (+ 1296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:22:02.204158 (+ 1555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:02.204163 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:02.204165 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:02.204359 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:02.204543 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:02.204544 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:02.204544 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:02.204628 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:02.204814 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:22:02.204818 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:22:02.204955 (+ 137us) client_negotiation.cc:769] Sending connection context
0809 23:22:02.205031 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 23:22:02.205134 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":85,"threads_started":1}
I20260809 23:22:02.205880 17776 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39419
I20260809 23:22:02.205986 17776 heartbeater.cc:464] Registering TS with master...
I20260809 23:22:02.206147 17776 heartbeater.cc:511] Master 127.1.235.190:39419 requested a full tablet report, sending...
I20260809 23:22:02.206530 17268 ts_manager.cc:194] Registered new tserver with Master: 27b74a856b4449e2af5b7b04f77af46c (127.1.235.131:44575)
I20260809 23:22:02.206897 17268 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:41149
I20260809 23:22:02.211073 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:22:02.217348 17310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.212332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35422 (local address 127.1.235.190:39419)
0809 23:22:02.212363 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:02.212365 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:02.212480 (+ 115us) server_negotiation.cc:407] Connection header received
0809 23:22:02.212529 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:02.212529 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:02.212536 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:02.212583 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:02.213073 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.213455 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.214125 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.214276 (+ 151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.214323 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.215218 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:02.215219 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:02.215219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:02.215224 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:02.216548 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:02.216846 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:02.216847 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:02.216847 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:02.216888 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:02.217026 (+ 138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:02.217026 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:02.217026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:02.217122 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:02.217189 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:02.217253 (+ 64us) server_negotiation.cc:299] Negotiation successful
0809 23:22:02.217300 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 23:22:02.218766 17268 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35422:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:22:02.220211 17268 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:22:02.226323 17791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.222293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:37697 (local address 127.0.0.1:33696)
0809 23:22:02.222419 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:02.222452 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:02.222509 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:02.223193 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:02.223194 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:02.223196 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:02.223233 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.223234 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.224331 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.224332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.225094 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.225096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.226013 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.226014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.226092 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.226106 (+ 14us) client_negotiation.cc:769] Sending connection context
0809 23:22:02.226207 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 23:22:02.226252 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":2,"thread_start_us":78,"threads_started":1}
I20260809 23:22:02.226490 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.222475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45756 (local address 127.1.235.131:44575)
0809 23:22:02.222621 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:02.222625 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:02.222942 (+ 317us) server_negotiation.cc:407] Connection header received
0809 23:22:02.223051 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:02.223054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:02.223066 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:02.223138 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:02.223295 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.223934 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.225390 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.226121 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.226211 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.226261 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:02.226355 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 23:22:02.226392 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":70,"threads_started":1}
I20260809 23:22:02.226846 17795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.222713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33696 (local address 127.1.235.129:37697)
0809 23:22:02.222861 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:02.222864 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:02.222874 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:22:02.222932 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:02.222934 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:02.222949 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:02.223020 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:02.223312 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.224244 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.225181 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.225927 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.226013 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.226069 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:02.226715 (+ 646us) server_negotiation.cc:299] Negotiation successful
0809 23:22:02.226759 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":84,"threads_started":1}
I20260809 23:22:02.226953 17790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.222266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:35417 (local address 127.0.0.1:41380)
0809 23:22:02.222418 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:02.222452 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:02.222509 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:02.222809 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:02.222811 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:02.222813 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:02.222867 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.222868 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.224052 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.224053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.225307 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.225309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.226735 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.226736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.226787 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.226791 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:22:02.226849 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 23:22:02.226893 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":52,"thread_start_us":49,"threads_started":1}
I20260809 23:22:02.227047 17789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.222297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:44575 (local address 127.0.0.1:45756)
0809 23:22:02.222875 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:02.222885 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:02.222966 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:02.223174 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:02.223175 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:02.223177 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:02.223215 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.223216 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.224054 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.224055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.225307 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.225309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.226215 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.226216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.226279 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.226283 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:22:02.226341 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 23:22:02.226944 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"mutex_wait_us":49,"thread_start_us":85,"threads_started":1}
I20260809 23:22:02.227205 17794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.222535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41380 (local address 127.1.235.130:35417)
0809 23:22:02.222678 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:02.222681 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:02.222688 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:22:02.222715 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:02.222716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:02.222726 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:02.222804 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:02.222923 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.223939 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.225886 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.226640 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.226713 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.226744 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:02.226866 (+ 122us) server_negotiation.cc:299] Negotiation successful
0809 23:22:02.227131 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":77,"threads_started":1}
I20260809 23:22:02.227537 17409 tablet_service.cc:1467] Processing CreateTablet for tablet ad23175922424a588ffffc00f1ebef7e (DEFAULT_TABLE table=test-table [id=2bf6b793867e49c18f3f695e6174199b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:22:02.227562 17707 tablet_service.cc:1467] Processing CreateTablet for tablet ad23175922424a588ffffc00f1ebef7e (DEFAULT_TABLE table=test-table [id=2bf6b793867e49c18f3f695e6174199b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:22:02.227873 17707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad23175922424a588ffffc00f1ebef7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:22:02.227873 17409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad23175922424a588ffffc00f1ebef7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:22:02.227784 17561 tablet_service.cc:1467] Processing CreateTablet for tablet ad23175922424a588ffffc00f1ebef7e (DEFAULT_TABLE table=test-table [id=2bf6b793867e49c18f3f695e6174199b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:22:02.228104 17561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad23175922424a588ffffc00f1ebef7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:22:02.230544 17796 tablet_bootstrap.cc:492] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404: Bootstrap starting.
I20260809 23:22:02.231031 17798 tablet_bootstrap.cc:492] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c: Bootstrap starting.
I20260809 23:22:02.231248 17796 tablet_bootstrap.cc:654] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404: Neither blocks nor log segments found. Creating new log.
I20260809 23:22:02.231725 17798 tablet_bootstrap.cc:654] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c: Neither blocks nor log segments found. Creating new log.
I20260809 23:22:02.231842 17796 log.cc:824] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:02.232263 17798 log.cc:824] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:02.232604 17796 tablet_bootstrap.cc:492] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404: No bootstrap required, opened a new log
I20260809 23:22:02.232609 17799 tablet_bootstrap.cc:492] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75: Bootstrap starting.
I20260809 23:22:02.232676 17796 ts_tablet_manager.cc:1397] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:22:02.232949 17798 tablet_bootstrap.cc:492] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c: No bootstrap required, opened a new log
I20260809 23:22:02.233024 17798 ts_tablet_manager.cc:1397] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:22:02.233191 17799 tablet_bootstrap.cc:654] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75: Neither blocks nor log segments found. Creating new log.
I20260809 23:22:02.233722 17799 log.cc:824] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:02.234489 17799 tablet_bootstrap.cc:492] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75: No bootstrap required, opened a new log
I20260809 23:22:02.234560 17799 ts_tablet_manager.cc:1397] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:22:02.234763 17798 raft_consensus.cc:348] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } }
I20260809 23:22:02.234910 17798 raft_consensus.cc:374] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:22:02.234814 17796 raft_consensus.cc:348] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } }
I20260809 23:22:02.234951 17798 raft_consensus.cc:729] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27b74a856b4449e2af5b7b04f77af46c, State: Initialized, Role: FOLLOWER
I20260809 23:22:02.234977 17796 raft_consensus.cc:374] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:22:02.235016 17796 raft_consensus.cc:729] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b993b0a2ee8427baa3e952bece61404, State: Initialized, Role: FOLLOWER
I20260809 23:22:02.235067 17798 consensus_queue.cc:260] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } }
I20260809 23:22:02.235116 17796 consensus_queue.cc:260] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } }
I20260809 23:22:02.235368 17798 ts_tablet_manager.cc:1428] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 23:22:02.235422 17631 heartbeater.cc:503] Master 127.1.235.190:39419 was elected leader, sending a full tablet report...
I20260809 23:22:02.235679 17776 heartbeater.cc:503] Master 127.1.235.190:39419 was elected leader, sending a full tablet report...
I20260809 23:22:02.235893 17796 ts_tablet_manager.cc:1428] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:22:02.236529 17799 raft_consensus.cc:348] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } }
I20260809 23:22:02.236709 17799 raft_consensus.cc:374] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:22:02.236756 17799 raft_consensus.cc:729] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca774ea32fdf4ea1b731ae428c29db75, State: Initialized, Role: FOLLOWER
I20260809 23:22:02.236860 17799 consensus_queue.cc:260] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } }
I20260809 23:22:02.237062 17799 ts_tablet_manager.cc:1428] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 23:22:02.237139 17484 heartbeater.cc:503] Master 127.1.235.190:39419 was elected leader, sending a full tablet report...
W20260809 23:22:02.276394 17632 tablet.cc:2369] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:22:02.304183 17804 raft_consensus.cc:482] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:22:02.304270 17804 raft_consensus.cc:504] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } }
I20260809 23:22:02.304627 17804 leader_election.cc:288] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417), ca774ea32fdf4ea1b731ae428c29db75 (127.1.235.129:37697)
I20260809 23:22:02.308199 17795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.304842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:56929 (local address 127.1.235.129:37697)
0809 23:22:02.304905 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:02.304907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:02.304917 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:22:02.304962 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:02.304963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:02.304981 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:02.305037 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:02.305189 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.305987 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.307398 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.307890 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.307959 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.307975 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:02.308107 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 23:22:02.308141 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 23:22:02.308198 17794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.304859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:37891 (local address 127.1.235.130:35417)
0809 23:22:02.304895 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:02.304897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:02.305141 (+ 244us) server_negotiation.cc:407] Connection header received
0809 23:22:02.305178 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:02.305179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:02.305189 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:02.305238 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:02.305336 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.306041 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.307400 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.307890 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.307959 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.307966 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:02.308112 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 23:22:02.308143 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:22:02.308215 17778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.304787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:37697 (local address 127.1.235.131:56929)
0809 23:22:02.304838 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:02.304849 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:02.304896 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:02.305051 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:02.305052 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:02.305054 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:02.305120 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.305122 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.306068 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.306069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.307317 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.307319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.307966 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.307967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.308041 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.308043 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:22:02.308088 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 23:22:02.308125 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":66}
I20260809 23:22:02.308225 17807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.304788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:35417 (local address 127.1.235.131:37891)
0809 23:22:02.305068 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:02.305076 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:02.305128 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:02.305241 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:02.305242 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:02.305243 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:02.305280 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.305281 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.306110 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.306111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.307317 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.307319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.307966 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.307967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.308034 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.308038 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:22:02.308088 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 23:22:02.308125 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":105,"thread_start_us":102,"threads_started":1}
I20260809 23:22:02.308619 17582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad23175922424a588ffffc00f1ebef7e" candidate_uuid: "27b74a856b4449e2af5b7b04f77af46c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b993b0a2ee8427baa3e952bece61404" is_pre_election: true
I20260809 23:22:02.308630 17431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad23175922424a588ffffc00f1ebef7e" candidate_uuid: "27b74a856b4449e2af5b7b04f77af46c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca774ea32fdf4ea1b731ae428c29db75" is_pre_election: true
I20260809 23:22:02.308751 17582 raft_consensus.cc:2454] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27b74a856b4449e2af5b7b04f77af46c in term 0.
I20260809 23:22:02.308768 17431 raft_consensus.cc:2454] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27b74a856b4449e2af5b7b04f77af46c in term 0.
I20260809 23:22:02.308991 17654 leader_election.cc:302] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27b74a856b4449e2af5b7b04f77af46c, ca774ea32fdf4ea1b731ae428c29db75; no voters:
I20260809 23:22:02.309108 17804 raft_consensus.cc:2781] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:22:02.309182 17804 raft_consensus.cc:482] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:22:02.309213 17804 raft_consensus.cc:3037] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:22:02.309852 17804 raft_consensus.cc:504] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } }
I20260809 23:22:02.309966 17804 leader_election.cc:288] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [CANDIDATE]: Term 1 election: Requested vote from peers 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417), ca774ea32fdf4ea1b731ae428c29db75 (127.1.235.129:37697)
I20260809 23:22:02.310086 17431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad23175922424a588ffffc00f1ebef7e" candidate_uuid: "27b74a856b4449e2af5b7b04f77af46c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca774ea32fdf4ea1b731ae428c29db75"
I20260809 23:22:02.310098 17582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad23175922424a588ffffc00f1ebef7e" candidate_uuid: "27b74a856b4449e2af5b7b04f77af46c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b993b0a2ee8427baa3e952bece61404"
I20260809 23:22:02.310176 17431 raft_consensus.cc:3037] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:22:02.310195 17582 raft_consensus.cc:3037] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:22:02.310819 17582 raft_consensus.cc:2454] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27b74a856b4449e2af5b7b04f77af46c in term 1.
I20260809 23:22:02.310837 17431 raft_consensus.cc:2454] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27b74a856b4449e2af5b7b04f77af46c in term 1.
I20260809 23:22:02.311036 17656 leader_election.cc:302] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27b74a856b4449e2af5b7b04f77af46c, 3b993b0a2ee8427baa3e952bece61404; no voters:
I20260809 23:22:02.311151 17804 raft_consensus.cc:2781] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:22:02.311296 17804 raft_consensus.cc:686] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [term 1 LEADER]: Becoming Leader. State: Replica: 27b74a856b4449e2af5b7b04f77af46c, State: Running, Role: LEADER
I20260809 23:22:02.311409 17804 consensus_queue.cc:237] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } }
I20260809 23:22:02.312180 17267 catalog_manager.cc:5495] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c reported cstate change: term changed from 0 to 1, leader changed from <none> to 27b74a856b4449e2af5b7b04f77af46c (127.1.235.131). New cstate: current_term: 1 leader_uuid: "27b74a856b4449e2af5b7b04f77af46c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } health_report { overall_health: HEALTHY } } }
I20260809 23:22:02.339820 17792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.337789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45768 (local address 127.1.235.131:44575)
0809 23:22:02.337848 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:02.337851 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:02.337879 (+ 28us) server_negotiation.cc:407] Connection header received
0809 23:22:02.337904 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:02.337904 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:02.337918 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:02.337965 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:22:02.338075 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.338509 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.339165 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.339334 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.339380 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.339534 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:22:02.339650 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:22:02.339710 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:02.339743 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 23:22:02.339759 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 23:22:02.341347 17582 raft_consensus.cc:1261] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404 [term 1 FOLLOWER]: Refusing update from remote peer 27b74a856b4449e2af5b7b04f77af46c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:22:02.341358 17431 raft_consensus.cc:1261] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Refusing update from remote peer 27b74a856b4449e2af5b7b04f77af46c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:22:02.341645 17804 consensus_queue.cc:1035] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:22:02.341802 17808 consensus_queue.cc:1035] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:22:02.346436 17267 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:22:02.346546 17267 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:22:02.347276 17267 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa: Sending DeleteTablet for 3 replicas of tablet ad23175922424a588ffffc00f1ebef7e
I20260809 23:22:02.347645 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 17339
I20260809 23:22:02.347626 17561 tablet_service.cc:1514] Processing DeleteTablet for tablet ad23175922424a588ffffc00f1ebef7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:22:02 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:41380
I20260809 23:22:02.347654 17409 tablet_service.cc:1514] Processing DeleteTablet for tablet ad23175922424a588ffffc00f1ebef7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:22:02 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:33696
I20260809 23:22:02.350317 17707 tablet_service.cc:1514] Processing DeleteTablet for tablet ad23175922424a588ffffc00f1ebef7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:22:02 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:45756
I20260809 23:22:02.350535 17822 tablet_replica.cc:330] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c: stopping tablet replica
I20260809 23:22:02.350571 17821 tablet_replica.cc:330] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404: stopping tablet replica
I20260809 23:22:02.350677 17821 raft_consensus.cc:2229] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:22:02.350697 17822 raft_consensus.cc:2229] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:22:02.350775 17821 raft_consensus.cc:2258] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:22:02.350952 17822 raft_consensus.cc:2258] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:22:02.351310 17821 ts_tablet_manager.cc:1905] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:22:02.351503 17822 ts_tablet_manager.cc:1905] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:22:02.353266 17822 ts_tablet_manager.cc:1918] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:22:02.353353 17821 ts_tablet_manager.cc:1918] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:22:02.353399 17822 log.cc:1196] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/ad23175922424a588ffffc00f1ebef7e
I20260809 23:22:02.353451 17821 log.cc:1196] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/ad23175922424a588ffffc00f1ebef7e
I20260809 23:22:02.353746 17821 ts_tablet_manager.cc:1939] T ad23175922424a588ffffc00f1ebef7e P 3b993b0a2ee8427baa3e952bece61404: Deleting consensus metadata
I20260809 23:22:02.353899 17822 ts_tablet_manager.cc:1939] T ad23175922424a588ffffc00f1ebef7e P 27b74a856b4449e2af5b7b04f77af46c: Deleting consensus metadata
I20260809 23:22:02.354135 17252 catalog_manager.cc:4841] TS 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417): tablet ad23175922424a588ffffc00f1ebef7e (table test-table [id=2bf6b793867e49c18f3f695e6174199b]) successfully deleted
I20260809 23:22:02.354264 17253 catalog_manager.cc:4841] TS 27b74a856b4449e2af5b7b04f77af46c (127.1.235.131:44575): tablet ad23175922424a588ffffc00f1ebef7e (table test-table [id=2bf6b793867e49c18f3f695e6174199b]) successfully deleted
W20260809 23:22:02.357142 17251 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.235.129:37697 (error 108)
I20260809 23:22:02.357707 17789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.357560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:37697 (local address 127.0.0.1:33708)
0809 23:22:02.357626 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:02.357667 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.129:37697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 23:22:02.357841 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 17490
W20260809 23:22:02.357846 17251 catalog_manager.cc:4584] TS ca774ea32fdf4ea1b731ae428c29db75 (127.1.235.129:37697): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ad23175922424a588ffffc00f1ebef7e: Network error: Client connection negotiation failed: client connection to 127.1.235.129:37697: connect: Connection refused (error 111)
I20260809 23:22:02.369688 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 17636
I20260809 23:22:02.376902 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 17232
I20260809 23:22:02.382392 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:39419
--webserver_interface=127.1.235.190
--webserver_port=39075
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:39419
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:22:02.454948 17825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:02.455139 17825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:02.455160 17825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:02.456322 17825 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:22:02.456365 17825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:02.456379 17825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:02.456393 17825 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:22:02.456404 17825 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:22:02.457911 17825 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:39419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:39419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=39075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:02.458137 17825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:02.458381 17825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:02.467374 17836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:02.467334 17833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:02.467792 17825 server_base.cc:1034] running on GCE node
W20260809 23:22:02.467357 17832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:02.468243 17825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:02.468555 17825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:02.469736 17825 hybrid_clock.cc:648] HybridClock initialized: now 1786317722469723 us; error 30 us; skew 500 ppm
Aug 09 23:22:02 dist-test-slave-6nmv krb5kdc[17218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317722, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:02.472468 17825 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:22:02.473007 17825 webserver.cc:460] Webserver started at http://127.1.235.190:39075/ using document root <none> and password file <none>
I20260809 23:22:02.473253 17825 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:02.473335 17825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:02.474814 17825 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:22:02.475555 17843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:02.475734 17825 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:22:02.475835 17825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "4065be1872104ddbb008d818e955c8fa"
format_stamp: "Formatted at 2026-08-09 23:22:01 on dist-test-slave-6nmv"
server_key: "9ce606a3b00878f42592b16b5d0c4428"
server_key_iv: "b701c52623cd8bf743c39f6fd6090c1f"
server_key_version: "encryptionkey@0"
I20260809 23:22:02.476265 17825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:02.491763 17825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:02.493950 17825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:02.494114 17825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:02.498768 17825 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:39419
I20260809 23:22:02.498829 17898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:39419 every 8 connection(s)
I20260809 23:22:02.499262 17825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:22:02.500885 17899 sys_catalog.cc:263] Verifying existing consensus state
I20260809 23:22:02.501559 17899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa: Bootstrap starting.
I20260809 23:22:02.507148 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 17825
I20260809 23:22:02.507417 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:37697
--local_ip_for_outbound_sockets=127.1.235.129
--tserver_master_addrs=127.1.235.190:39419
--webserver_port=45387
--webserver_interface=127.1.235.129
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:22:02.510036 17899 log.cc:824] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:02.511922 17899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 23:22:02.512198 17899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa: Bootstrap complete.
I20260809 23:22:02.514487 17899 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } }
I20260809 23:22:02.514725 17899 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4065be1872104ddbb008d818e955c8fa, State: Initialized, Role: FOLLOWER
I20260809 23:22:02.514889 17899 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } }
I20260809 23:22:02.514967 17899 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:22:02.515020 17899 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:22:02.515066 17899 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 1 FOLLOWER]: Advancing to term 2
I20260809 23:22:02.516038 17899 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } }
I20260809 23:22:02.516155 17899 leader_election.cc:302] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4065be1872104ddbb008d818e955c8fa; no voters:
I20260809 23:22:02.516327 17899 leader_election.cc:288] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 23:22:02.516378 17903 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 2 FOLLOWER]: Leader election won for term 2
I20260809 23:22:02.516539 17903 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 2 LEADER]: Becoming Leader. State: Replica: 4065be1872104ddbb008d818e955c8fa, State: Running, Role: LEADER
I20260809 23:22:02.516585 17899 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:22:02.516660 17903 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } }
I20260809 23:22:02.516939 17903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4065be1872104ddbb008d818e955c8fa. Latest consensus state: current_term: 2 leader_uuid: "4065be1872104ddbb008d818e955c8fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } } }
I20260809 23:22:02.517012 17903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [sys.catalog]: This master's current role is: LEADER
I20260809 23:22:02.517153 17904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4065be1872104ddbb008d818e955c8fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } } }
I20260809 23:22:02.517215 17904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [sys.catalog]: This master's current role is: LEADER
I20260809 23:22:02.517417 17910 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:22:02.518282 17910 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:22:02.518440 17910 catalog_manager.cc:1259] Loaded cluster ID: 4702505dbd874d7ab403df70d8363e7a
I20260809 23:22:02.518669 17910 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:22:02.518900 17910 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 23:22:02.521320 17910 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 23:22:02.526777 17910 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:22:02.526957 17910 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa: Loaded TSK: 0
I20260809 23:22:02.527150 17910 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 23:22:02.598927 17901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:02.599126 17901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:02.599175 17901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:02.600350 17901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:02.600400 17901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:02.600436 17901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:22:02.602739 17901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:37697
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=45387
--tserver_master_addrs=127.1.235.190:39419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17901
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:02.602964 17901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:02.603201 17901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:02.609391 17932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:02.609499 17901 server_base.cc:1034] running on GCE node
W20260809 23:22:02.609436 17929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:02.609603 17930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:02.609855 17901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:02.610140 17901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:02.611328 17901 hybrid_clock.cc:648] HybridClock initialized: now 1786317722611313 us; error 32 us; skew 500 ppm
Aug 09 23:22:02 dist-test-slave-6nmv krb5kdc[17218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317722, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:02.618417 17901 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:22:02.618901 17901 webserver.cc:460] Webserver started at http://127.1.235.129:45387/ using document root <none> and password file <none>
I20260809 23:22:02.619117 17901 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:02.619199 17901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:02.620555 17901 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:22:02.621282 17940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:02.621461 17901 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:22:02.621591 17901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "ca774ea32fdf4ea1b731ae428c29db75"
format_stamp: "Formatted at 2026-08-09 23:22:01 on dist-test-slave-6nmv"
server_key: "05ad13c00b63dca5dc4867e707aa90af"
server_key_iv: "974da1b661a4b2a74389d1aa4755234c"
server_key_version: "encryptionkey@0"
I20260809 23:22:02.621989 17901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:02.639578 17901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:02.641661 17901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:02.641794 17901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:02.642059 17901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:22:02.642542 17947 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 23:22:02.643946 17901 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 23:22:02.643994 17901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 23:22:02.644025 17901 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 23:22:02.644690 17901 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 23:22:02.644735 17901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 23:22:02.644779 17947 tablet_bootstrap.cc:492] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75: Bootstrap starting.
I20260809 23:22:02.652587 17901 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:37697
I20260809 23:22:02.652766 18061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:37697 every 8 connection(s)
I20260809 23:22:02.653074 17901 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:22:02.655903 17947 log.cc:824] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:02.658329 17947 tablet_bootstrap.cc:492] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 23:22:02.658634 17947 tablet_bootstrap.cc:492] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75: Bootstrap complete.
I20260809 23:22:02.659796 17947 ts_tablet_manager.cc:1397] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.011s
Aug 09 23:22:02 dist-test-slave-6nmv krb5kdc[17218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317722, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:22:02.660840 17947 raft_consensus.cc:348] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } }
I20260809 23:22:02.661118 17947 raft_consensus.cc:729] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca774ea32fdf4ea1b731ae428c29db75, State: Initialized, Role: FOLLOWER
I20260809 23:22:02.661243 17947 consensus_queue.cc:260] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } }
I20260809 23:22:02.661505 17947 ts_tablet_manager.cc:1428] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260809 23:22:02.662885 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 17901
I20260809 23:22:02.663141 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:35417
--local_ip_for_outbound_sockets=127.1.235.130
--tserver_master_addrs=127.1.235.190:39419
--webserver_port=43665
--webserver_interface=127.1.235.130
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:22:02.664397 18065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.653879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:36567 (local address 127.1.235.190:39419)
0809 23:22:02.654798 (+ 919us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:02.654806 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:02.654835 (+ 29us) server_negotiation.cc:407] Connection header received
0809 23:22:02.654961 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:02.654966 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:02.655014 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:02.655131 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:02.656044 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.657077 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.658565 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.658996 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.659070 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.661335 (+ 2265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:02.661339 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:02.661339 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:02.661353 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:02.662764 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:02.663198 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:02.663201 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:02.663201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:02.663310 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:02.663556 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:02.663557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:02.663557 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:02.663757 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:02.663838 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:02.664112 (+ 274us) server_negotiation.cc:299] Negotiation successful
0809 23:22:02.664221 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":872,"thread_start_us":95,"threads_started":1}
I20260809 23:22:02.664397 18064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.653796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:36567)
0809 23:22:02.654088 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:02.654130 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:02.654617 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:02.655222 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:02.655227 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:02.655617 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:22:02.655886 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.655893 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.657194 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.657196 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.658471 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.658474 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.659092 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.659093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.659231 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.659738 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:22:02.659746 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:22:02.661244 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:22:02.662844 (+ 1600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:02.662851 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:02.662852 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:02.663119 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:02.663390 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:02.663390 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:02.663390 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:02.663479 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:02.663831 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:22:02.663837 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:22:02.663956 (+ 119us) client_negotiation.cc:769] Sending connection context
0809 23:22:02.664063 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 23:22:02.664210 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":96,"threads_started":1}
I20260809 23:22:02.665087 18062 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39419
I20260809 23:22:02.665180 18062 heartbeater.cc:464] Registering TS with master...
I20260809 23:22:02.665367 18062 heartbeater.cc:511] Master 127.1.235.190:39419 requested a full tablet report, sending...
I20260809 23:22:02.666160 17861 ts_manager.cc:194] Registered new tserver with Master: ca774ea32fdf4ea1b731ae428c29db75 (127.1.235.129:37697)
I20260809 23:22:02.667313 17861 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:36567
I20260809 23:22:02.668282 18062 heartbeater.cc:503] Master 127.1.235.190:39419 was elected leader, sending a full tablet report...
Aug 09 23:22:02 dist-test-slave-6nmv krb5kdc[17218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317722, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for kudu/127.1.235.129@KRBTEST.COM
I20260809 23:22:02.674228 18069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.666764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:37697 (local address 127.0.0.1:33716)
0809 23:22:02.667006 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:02.667029 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:02.667112 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:02.667284 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:02.667289 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:02.667634 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:22:02.667682 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.667684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.668528 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.668529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.669011 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.669013 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.669402 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.669403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.669479 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.669958 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:22:02.669962 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:22:02.671139 (+ 1177us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:22:02.673217 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:02.673222 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:02.673224 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:02.673398 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:02.673612 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:02.673613 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:02.673613 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:02.673662 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:02.673989 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:22:02.673994 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:22:02.674031 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 23:22:02.674089 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 23:22:02.674169 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":87,"threads_started":1}
I20260809 23:22:02.674343 18070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.666812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33716 (local address 127.1.235.129:37697)
0809 23:22:02.666945 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:02.666948 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:02.667095 (+ 147us) server_negotiation.cc:407] Connection header received
0809 23:22:02.667180 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:02.667182 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:02.667193 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:02.667268 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:02.667782 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.668406 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.669096 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.669334 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.669402 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.671224 (+ 1822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:02.671233 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:02.671234 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:02.671242 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:02.673141 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:02.673476 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:02.673479 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:02.673480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:02.673543 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:02.673719 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:02.673720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:02.673720 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:02.673915 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:02.674011 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:02.674125 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 23:22:02.674223 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
I20260809 23:22:02.674685 17992 tablet_service.cc:1514] Processing DeleteTablet for tablet ad23175922424a588ffffc00f1ebef7e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:22:02 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:33716
I20260809 23:22:02.675132 18071 tablet_replica.cc:330] stopping tablet replica
I20260809 23:22:02.675240 18071 raft_consensus.cc:2229] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:22:02.675297 18071 raft_consensus.cc:2258] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:22:02.675601 18071 ts_tablet_manager.cc:1905] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:22:02.677516 18071 ts_tablet_manager.cc:1918] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:22:02.677599 18071 log.cc:1196] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal/wals/ad23175922424a588ffffc00f1ebef7e
I20260809 23:22:02.677860 18071 ts_tablet_manager.cc:1939] T ad23175922424a588ffffc00f1ebef7e P ca774ea32fdf4ea1b731ae428c29db75: Deleting consensus metadata
I20260809 23:22:02.678337 17845 catalog_manager.cc:4841] TS ca774ea32fdf4ea1b731ae428c29db75 (127.1.235.129:37697): tablet ad23175922424a588ffffc00f1ebef7e (table test-table [id=2bf6b793867e49c18f3f695e6174199b]) successfully deleted
W20260809 23:22:02.740411 18068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:02.740598 18068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:02.740633 18068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:02.741647 18068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:02.741706 18068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:02.741750 18068 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:22:02.743319 18068 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:35417
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=43665
--tserver_master_addrs=127.1.235.190:39419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:02.743554 18068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:02.743780 18068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:02.748469 18078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:02.748479 18077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:02.748560 18080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:02.748649 18068 server_base.cc:1034] running on GCE node
I20260809 23:22:02.748826 18068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:02.749073 18068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:02.750221 18068 hybrid_clock.cc:648] HybridClock initialized: now 1786317722750209 us; error 23 us; skew 500 ppm
Aug 09 23:22:02 dist-test-slave-6nmv krb5kdc[17218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317722, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:02.752451 18068 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:22:02.752871 18068 webserver.cc:460] Webserver started at http://127.1.235.130:43665/ using document root <none> and password file <none>
I20260809 23:22:02.753096 18068 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:02.753171 18068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:02.754360 18068 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:22:02.754844 18087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:02.755003 18068 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:22:02.755089 18068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "3b993b0a2ee8427baa3e952bece61404"
format_stamp: "Formatted at 2026-08-09 23:22:01 on dist-test-slave-6nmv"
server_key: "7f56faa63bed90b9c10a3f3e4c92ad23"
server_key_iv: "62499ff38d352fa9a2eda61e3a2a53d6"
server_key_version: "encryptionkey@0"
I20260809 23:22:02.755362 18068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:02.768966 18068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:02.770661 18068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:02.770803 18068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:02.771005 18068 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:22:02.771275 18068 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:22:02.771327 18068 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:02.771361 18068 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:22:02.771405 18068 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:02.777213 18068 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:35417
I20260809 23:22:02.777261 18213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:35417 every 8 connection(s)
I20260809 23:22:02.777580 18068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:22:02.779178 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 18068
I20260809 23:22:02.779505 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:44575
--local_ip_for_outbound_sockets=127.1.235.131
--tserver_master_addrs=127.1.235.190:39419
--webserver_port=36661
--webserver_interface=127.1.235.131
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 23:22:02 dist-test-slave-6nmv krb5kdc[17218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317722, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:22:02.787464 18065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.778275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:47029 (local address 127.1.235.190:39419)
0809 23:22:02.778337 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:02.778339 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:02.778535 (+ 196us) server_negotiation.cc:407] Connection header received
0809 23:22:02.779032 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:02.779033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:02.779059 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:02.779142 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:02.780287 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.780745 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.781846 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.782211 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.782288 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.784565 (+ 2277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:02.784566 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:02.784566 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:02.784572 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:02.785992 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:02.786504 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:02.786505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:02.786505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:02.786558 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:02.786857 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:02.786858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:02.786858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:02.786952 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:02.786996 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:02.787329 (+ 333us) server_negotiation.cc:299] Negotiation successful
0809 23:22:02.787397 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 23:22:02.787741 18216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.778260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:47029)
0809 23:22:02.778425 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:02.778463 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:02.778904 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:02.779211 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:02.779215 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:02.779950 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:22:02.780196 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.780202 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.780849 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.780850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.781747 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.781749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.782293 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.782294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.782388 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.782851 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:22:02.782858 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:22:02.784474 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:22:02.786071 (+ 1597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:02.786078 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:02.786080 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:02.786421 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:02.786622 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:02.786622 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:02.786623 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:02.786785 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:02.787013 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:22:02.787019 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:22:02.787185 (+ 166us) client_negotiation.cc:769] Sending connection context
0809 23:22:02.787315 (+ 130us) client_negotiation.cc:240] Negotiation successful
0809 23:22:02.787494 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":99,"threads_started":1}
I20260809 23:22:02.788303 18214 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39419
I20260809 23:22:02.788410 18214 heartbeater.cc:464] Registering TS with master...
I20260809 23:22:02.788594 18214 heartbeater.cc:511] Master 127.1.235.190:39419 requested a full tablet report, sending...
I20260809 23:22:02.788991 17861 ts_manager.cc:194] Registered new tserver with Master: 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417)
I20260809 23:22:02.789340 17861 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:47029
W20260809 23:22:02.857030 18217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:02.857187 18217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:02.857205 18217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:02.858258 18217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:02.858297 18217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:02.858319 18217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:22:02.859715 18217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:44575
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=36661
--tserver_master_addrs=127.1.235.190:39419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:02.859948 18217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:02.860169 18217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:02.864753 18225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:02.864753 18222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:02.864773 18223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:02.865103 18217 server_base.cc:1034] running on GCE node
I20260809 23:22:02.865317 18217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:02.865587 18217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:02.866757 18217 hybrid_clock.cc:648] HybridClock initialized: now 1786317722866741 us; error 27 us; skew 500 ppm
Aug 09 23:22:02 dist-test-slave-6nmv krb5kdc[17218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317722, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:02.869074 18217 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:22:02.869474 18217 webserver.cc:460] Webserver started at http://127.1.235.131:36661/ using document root <none> and password file <none>
I20260809 23:22:02.869688 18217 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:02.869769 18217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:02.871551 18217 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:22:02.872205 18233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:02.872416 18217 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:22:02.872551 18217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "27b74a856b4449e2af5b7b04f77af46c"
format_stamp: "Formatted at 2026-08-09 23:22:02 on dist-test-slave-6nmv"
server_key: "ca063fcbd89f99af20e5755e3c4bf849"
server_key_iv: "667e32d12705f62b183ad28fb3befb48"
server_key_version: "encryptionkey@0"
I20260809 23:22:02.872869 18217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:02.897202 18217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:02.898805 18217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:02.898942 18217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:02.899137 18217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:22:02.899394 18217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:22:02.899423 18217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:02.899446 18217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:22:02.899487 18217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:02.904722 18217 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:44575
I20260809 23:22:02.904788 18361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:44575 every 8 connection(s)
I20260809 23:22:02.905099 18217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
Aug 09 23:22:02 dist-test-slave-6nmv krb5kdc[17218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317722, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:22:02.913516 18065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.905815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:43783 (local address 127.1.235.190:39419)
0809 23:22:02.905903 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:02.905905 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:02.906096 (+ 191us) server_negotiation.cc:407] Connection header received
0809 23:22:02.906528 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:02.906529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:02.906540 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:02.906591 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:02.907379 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.907882 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.908811 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.908998 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.909049 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.911060 (+ 2011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:02.911062 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:02.911062 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:02.911068 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:02.912343 (+ 1275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:02.912723 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:02.912724 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:02.912724 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:02.912774 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:02.913005 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:02.913005 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:02.913005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:02.913127 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:02.913172 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:02.913387 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 23:22:02.913454 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 23:22:02.913717 18364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.905788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:43783)
0809 23:22:02.905998 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:02.906031 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:02.906448 (+ 417us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:02.906641 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:02.906644 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:02.907158 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:22:02.907313 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.907317 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.907955 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.907955 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.908736 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.908737 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.909084 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.909085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.909180 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.909677 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:22:02.909685 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:22:02.910982 (+ 1297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:22:02.912437 (+ 1455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:02.912444 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:02.912445 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:02.912671 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:02.912825 (+ 154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:02.912825 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:02.912825 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:02.912943 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:02.913177 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:22:02.913180 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:22:02.913295 (+ 115us) client_negotiation.cc:769] Sending connection context
0809 23:22:02.913369 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 23:22:02.913480 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":145,"threads_started":1}
I20260809 23:22:02.914309 18362 heartbeater.cc:347] Connected to a master server at 127.1.235.190:39419
I20260809 23:22:02.914410 18362 heartbeater.cc:464] Registering TS with master...
I20260809 23:22:02.914589 18362 heartbeater.cc:511] Master 127.1.235.190:39419 requested a full tablet report, sending...
I20260809 23:22:02.914984 17861 ts_manager.cc:194] Registered new tserver with Master: 27b74a856b4449e2af5b7b04f77af46c (127.1.235.131:44575)
I20260809 23:22:02.915136 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 18217
I20260809 23:22:02.915463 17861 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:43783
I20260809 23:22:02.920965 18065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.915486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35428 (local address 127.1.235.190:39419)
0809 23:22:02.915542 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:02.915562 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:02.915721 (+ 159us) server_negotiation.cc:407] Connection header received
0809 23:22:02.915815 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:02.915816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:02.915825 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:02.915879 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:02.916552 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.916993 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.917727 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.917955 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.918003 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.919091 (+ 1088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:02.919091 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:02.919091 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:02.919096 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:02.920184 (+ 1088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:02.920463 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:02.920464 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:02.920464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:02.920508 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:02.920627 (+ 119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:02.920627 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:02.920628 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:02.920705 (+ 77us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:02.920810 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:02.920852 (+ 42us) server_negotiation.cc:299] Negotiation successful
0809 23:22:02.920901 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 23:22:02.921751 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:22:02.924182 18065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.922133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35430 (local address 127.1.235.190:39419)
0809 23:22:02.922168 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:02.922169 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:02.922231 (+ 62us) server_negotiation.cc:407] Connection header received
0809 23:22:02.922308 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:02.922309 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:02.922334 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:02.922386 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:22:02.922495 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.922884 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.923574 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.923741 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.923785 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.923963 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:22:02.924037 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:22:02.924091 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:02.924129 (+ 38us) server_negotiation.cc:299] Negotiation successful
0809 23:22:02.924141 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 23:22:02.924489 17861 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:35430:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:22:02.926352 17861 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:22:02.928622 17992 tablet_service.cc:1467] Processing CreateTablet for tablet 672c4f4ac14748d3aa60e274ed7b3a56 (DEFAULT_TABLE table=test-table [id=789d9222c518454f959e6b70bc9bb838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:22:02.928817 17992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 672c4f4ac14748d3aa60e274ed7b3a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:22:02.930361 17947 tablet_bootstrap.cc:492] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75: Bootstrap starting.
I20260809 23:22:02.930727 17947 tablet_bootstrap.cc:654] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75: Neither blocks nor log segments found. Creating new log.
I20260809 23:22:02.931979 17947 tablet_bootstrap.cc:492] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75: No bootstrap required, opened a new log
I20260809 23:22:02.932039 17947 ts_tablet_manager.cc:1397] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 23:22:02.932073 18367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.928275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:44575 (local address 127.0.0.1:45784)
0809 23:22:02.928386 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:02.928397 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:02.928450 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:02.928781 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:02.928782 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:02.928784 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:02.928824 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.928826 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.929940 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.929941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.930937 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.930940 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.931784 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.931785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.931847 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.931866 (+ 19us) client_negotiation.cc:769] Sending connection context
0809 23:22:02.931958 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 23:22:02.931998 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":69,"threads_started":1}
I20260809 23:22:02.932199 17947 raft_consensus.cc:348] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } }
I20260809 23:22:02.932276 17947 raft_consensus.cc:374] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:22:02.932315 17947 raft_consensus.cc:729] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca774ea32fdf4ea1b731ae428c29db75, State: Initialized, Role: FOLLOWER
I20260809 23:22:02.932333 18369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.928451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45784 (local address 127.1.235.131:44575)
0809 23:22:02.928638 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:02.928642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:02.928650 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:22:02.928676 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:02.928677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:02.928688 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:02.928775 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:02.928878 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.929785 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.931018 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.931691 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.931752 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.931824 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:02.931975 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 23:22:02.932014 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":96,"threads_started":1}
I20260809 23:22:02.932361 17947 consensus_queue.cc:260] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } }
I20260809 23:22:02.932449 17947 ts_tablet_manager.cc:1428] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260809 23:22:02.933013 18286 tablet_service.cc:1467] Processing CreateTablet for tablet 672c4f4ac14748d3aa60e274ed7b3a56 (DEFAULT_TABLE table=test-table [id=789d9222c518454f959e6b70bc9bb838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:22:02.933421 18286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 672c4f4ac14748d3aa60e274ed7b3a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:22:02.933928 18069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.928225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:35417 (local address 127.0.0.1:41388)
0809 23:22:02.928286 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:02.928297 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:02.928329 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:02.930111 (+ 1782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:02.930112 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:02.930113 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:02.930152 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.930153 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.931496 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.931497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.932727 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:02.932730 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.933680 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.933681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:02.933741 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.933745 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:22:02.933801 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 23:22:02.933867 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 23:22:02.933969 18368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:02.928308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41388 (local address 127.1.235.130:35417)
0809 23:22:02.929960 (+ 1652us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:02.929964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:02.929973 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:22:02.930013 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:02.930015 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:02.930027 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:02.930114 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:02.930209 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.931396 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.932820 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:02.933594 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:02.933681 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:02.933736 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:02.933842 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 23:22:02.933879 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1612,"thread_start_us":109,"threads_started":1}
I20260809 23:22:02.934509 18142 tablet_service.cc:1467] Processing CreateTablet for tablet 672c4f4ac14748d3aa60e274ed7b3a56 (DEFAULT_TABLE table=test-table [id=789d9222c518454f959e6b70bc9bb838]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:22:02.934744 18142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 672c4f4ac14748d3aa60e274ed7b3a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:22:02.936468 18371 tablet_bootstrap.cc:492] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c: Bootstrap starting.
I20260809 23:22:02.937134 18371 tablet_bootstrap.cc:654] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c: Neither blocks nor log segments found. Creating new log.
I20260809 23:22:02.937419 18372 tablet_bootstrap.cc:492] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404: Bootstrap starting.
I20260809 23:22:02.937690 18371 log.cc:824] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:02.938014 18372 tablet_bootstrap.cc:654] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404: Neither blocks nor log segments found. Creating new log.
I20260809 23:22:02.938478 18372 log.cc:824] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:02.938539 18371 tablet_bootstrap.cc:492] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c: No bootstrap required, opened a new log
I20260809 23:22:02.938619 18371 ts_tablet_manager.cc:1397] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:22:02.939313 18372 tablet_bootstrap.cc:492] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404: No bootstrap required, opened a new log
I20260809 23:22:02.939415 18372 ts_tablet_manager.cc:1397] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:22:02.940534 18371 raft_consensus.cc:348] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } }
I20260809 23:22:02.940677 18371 raft_consensus.cc:374] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:22:02.940702 18371 raft_consensus.cc:729] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27b74a856b4449e2af5b7b04f77af46c, State: Initialized, Role: FOLLOWER
I20260809 23:22:02.940840 18371 consensus_queue.cc:260] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } }
I20260809 23:22:02.940845 18372 raft_consensus.cc:348] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } }
I20260809 23:22:02.941046 18372 raft_consensus.cc:374] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:22:02.941090 18372 raft_consensus.cc:729] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b993b0a2ee8427baa3e952bece61404, State: Initialized, Role: FOLLOWER
I20260809 23:22:02.941161 18362 heartbeater.cc:503] Master 127.1.235.190:39419 was elected leader, sending a full tablet report...
I20260809 23:22:02.941228 18372 consensus_queue.cc:260] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } }
I20260809 23:22:02.941152 18371 ts_tablet_manager.cc:1428] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 23:22:02.941537 18372 ts_tablet_manager.cc:1428] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:22:02.941574 18214 heartbeater.cc:503] Master 127.1.235.190:39419 was elected leader, sending a full tablet report...
I20260809 23:22:03.021867 18067 raft_consensus.cc:482] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:22:03.022027 18067 raft_consensus.cc:504] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } }
I20260809 23:22:03.022393 18067 leader_election.cc:288] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417), 27b74a856b4449e2af5b7b04f77af46c (127.1.235.131:44575)
I20260809 23:22:03.025223 18369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:03.022760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:49575 (local address 127.1.235.131:44575)
0809 23:22:03.022801 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:03.022802 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:03.022872 (+ 70us) server_negotiation.cc:407] Connection header received
0809 23:22:03.022916 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:03.022917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:03.022925 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:03.022979 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:03.023144 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:03.023582 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:03.024513 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:03.024851 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:03.024902 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:03.024908 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:03.025102 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 23:22:03.025153 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:22:03.025223 18064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:03.022548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:35417 (local address 127.1.235.129:55407)
0809 23:22:03.022604 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:03.022616 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:03.022686 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:03.022877 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:03.022878 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:03.022880 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:03.022964 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:03.022966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:03.023579 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:03.023580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:03.024405 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:03.024407 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:03.024984 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:03.024985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:03.025073 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:03.025076 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:22:03.025127 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 23:22:03.025159 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":3}
I20260809 23:22:03.025235 18368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:03.022624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:55407 (local address 127.1.235.130:35417)
0809 23:22:03.022690 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:03.022692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:03.022701 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:22:03.022781 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:03.022783 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:03.022792 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:03.022860 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:03.023030 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:03.023511 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:03.024484 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:03.024869 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:03.024975 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:03.024983 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:03.025144 (+ 161us) server_negotiation.cc:299] Negotiation successful
0809 23:22:03.025181 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 23:22:03.025236 18377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:03.022618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:44575 (local address 127.1.235.129:49575)
0809 23:22:03.022806 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:03.022815 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:03.022869 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:03.023007 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:03.023008 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:03.023010 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:03.023080 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:03.023081 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:03.023653 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:03.023654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:03.024403 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:03.024405 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:03.024928 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:03.024930 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:03.024996 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:03.025021 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 23:22:03.025086 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 23:22:03.025140 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":1,"thread_start_us":100,"threads_started":1}
I20260809 23:22:03.025595 18165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "672c4f4ac14748d3aa60e274ed7b3a56" candidate_uuid: "ca774ea32fdf4ea1b731ae428c29db75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b993b0a2ee8427baa3e952bece61404" is_pre_election: true
I20260809 23:22:03.025724 18165 raft_consensus.cc:2454] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca774ea32fdf4ea1b731ae428c29db75 in term 0.
I20260809 23:22:03.025667 18311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "672c4f4ac14748d3aa60e274ed7b3a56" candidate_uuid: "ca774ea32fdf4ea1b731ae428c29db75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27b74a856b4449e2af5b7b04f77af46c" is_pre_election: true
I20260809 23:22:03.025861 18311 raft_consensus.cc:2454] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ca774ea32fdf4ea1b731ae428c29db75 in term 0.
I20260809 23:22:03.025998 17943 leader_election.cc:302] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b993b0a2ee8427baa3e952bece61404, ca774ea32fdf4ea1b731ae428c29db75; no voters:
I20260809 23:22:03.026113 18067 raft_consensus.cc:2781] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:22:03.026168 18067 raft_consensus.cc:482] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:22:03.026189 18067 raft_consensus.cc:3037] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:22:03.026875 18067 raft_consensus.cc:504] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } }
I20260809 23:22:03.027005 18067 leader_election.cc:288] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 1 election: Requested vote from peers 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417), 27b74a856b4449e2af5b7b04f77af46c (127.1.235.131:44575)
I20260809 23:22:03.027120 18165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "672c4f4ac14748d3aa60e274ed7b3a56" candidate_uuid: "ca774ea32fdf4ea1b731ae428c29db75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b993b0a2ee8427baa3e952bece61404"
I20260809 23:22:03.027160 18311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "672c4f4ac14748d3aa60e274ed7b3a56" candidate_uuid: "ca774ea32fdf4ea1b731ae428c29db75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27b74a856b4449e2af5b7b04f77af46c"
I20260809 23:22:03.027190 18165 raft_consensus.cc:3037] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:22:03.027240 18311 raft_consensus.cc:3037] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:22:03.027937 18165 raft_consensus.cc:2454] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca774ea32fdf4ea1b731ae428c29db75 in term 1.
I20260809 23:22:03.027938 18311 raft_consensus.cc:2454] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca774ea32fdf4ea1b731ae428c29db75 in term 1.
W20260809 23:22:03.028076 18215 tablet.cc:2369] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:22:03.028117 17943 leader_election.cc:302] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b993b0a2ee8427baa3e952bece61404, ca774ea32fdf4ea1b731ae428c29db75; no voters:
I20260809 23:22:03.028211 18067 raft_consensus.cc:2781] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:22:03.028349 18067 raft_consensus.cc:686] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 LEADER]: Becoming Leader. State: Replica: ca774ea32fdf4ea1b731ae428c29db75, State: Running, Role: LEADER
I20260809 23:22:03.028460 18067 consensus_queue.cc:237] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } }
I20260809 23:22:03.029138 17861 catalog_manager.cc:5495] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 reported cstate change: term changed from 0 to 1, leader changed from <none> to ca774ea32fdf4ea1b731ae428c29db75 (127.1.235.129). New cstate: current_term: 1 leader_uuid: "ca774ea32fdf4ea1b731ae428c29db75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } health_report { overall_health: HEALTHY } } }
I20260809 23:22:03.046551 18070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:03.044524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33726 (local address 127.1.235.129:37697)
0809 23:22:03.044573 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:03.044575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:03.044583 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:22:03.044630 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:03.044631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:03.044643 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:03.044692 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:22:03.044781 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:03.045188 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:03.045871 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:03.046089 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:03.046140 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:03.046276 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:22:03.046358 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:22:03.046411 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:03.046455 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 23:22:03.046470 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 23:22:03.047834 18311 raft_consensus.cc:1261] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c [term 1 FOLLOWER]: Refusing update from remote peer ca774ea32fdf4ea1b731ae428c29db75: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:22:03.047863 18165 raft_consensus.cc:1261] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404 [term 1 FOLLOWER]: Refusing update from remote peer ca774ea32fdf4ea1b731ae428c29db75: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:22:03.048118 18067 consensus_queue.cc:1035] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:22:03.048285 18378 consensus_queue.cc:1035] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:22:03.050103 18381 mvcc.cc:205] Tried to move back new op lower bound from 7316757393601626112 to 7316757393525137408. Current Snapshot: MvccSnapshot[applied={T|T < 7316757393601626112}]
I20260809 23:22:03.050470 18382 mvcc.cc:205] Tried to move back new op lower bound from 7316757393601626112 to 7316757393525137408. Current Snapshot: MvccSnapshot[applied={T|T < 7316757393601626112}]
I20260809 23:22:03.052187 17861 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:35430:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:22:03.052273 17861 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:35430:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:22:03.052942 17861 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa: Sending DeleteTablet for 3 replicas of tablet 672c4f4ac14748d3aa60e274ed7b3a56
I20260809 23:22:03.053118 18385 mvcc.cc:205] Tried to move back new op lower bound from 7316757393601626112 to 7316757393525137408. Current Snapshot: MvccSnapshot[applied={T|T < 7316757393601626112}]
I20260809 23:22:03.053236 18142 tablet_service.cc:1514] Processing DeleteTablet for tablet 672c4f4ac14748d3aa60e274ed7b3a56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:22:03 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:41388
I20260809 23:22:03.053263 17992 tablet_service.cc:1514] Processing DeleteTablet for tablet 672c4f4ac14748d3aa60e274ed7b3a56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:22:03 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:33716
I20260809 23:22:03.053354 17991 tablet_service.cc:1514] Processing DeleteTablet for tablet 672c4f4ac14748d3aa60e274ed7b3a56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:22:03 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:33716
I20260809 23:22:03.053406 18071 tablet_replica.cc:330] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75: stopping tablet replica
I20260809 23:22:03.053472 18071 raft_consensus.cc:2229] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:22:03.053550 18071 raft_consensus.cc:2258] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:22:03.053828 18071 ts_tablet_manager.cc:1905] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:22:03.053957 18286 tablet_service.cc:1514] Processing DeleteTablet for tablet 672c4f4ac14748d3aa60e274ed7b3a56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:22:03 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:45784
I20260809 23:22:03.054127 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 17901
I20260809 23:22:03.054131 18394 tablet_replica.cc:330] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c: stopping tablet replica
I20260809 23:22:03.054250 18394 raft_consensus.cc:2229] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:22:03.054304 18394 raft_consensus.cc:2258] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:22:03.057751 18393 tablet_replica.cc:330] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404: stopping tablet replica
I20260809 23:22:03.057865 18393 raft_consensus.cc:2229] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:22:03.057976 18393 raft_consensus.cc:2258] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:22:03.058475 18393 ts_tablet_manager.cc:1905] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:22:03.059054 18394 ts_tablet_manager.cc:1905] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:22:03.060369 18393 ts_tablet_manager.cc:1918] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:22:03.060463 18393 log.cc:1196] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/672c4f4ac14748d3aa60e274ed7b3a56
I20260809 23:22:03.060530 18394 ts_tablet_manager.cc:1918] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:22:03.060598 18394 log.cc:1196] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/672c4f4ac14748d3aa60e274ed7b3a56
I20260809 23:22:03.060729 18393 ts_tablet_manager.cc:1939] T 672c4f4ac14748d3aa60e274ed7b3a56 P 3b993b0a2ee8427baa3e952bece61404: Deleting consensus metadata
I20260809 23:22:03.060901 18394 ts_tablet_manager.cc:1939] T 672c4f4ac14748d3aa60e274ed7b3a56 P 27b74a856b4449e2af5b7b04f77af46c: Deleting consensus metadata
I20260809 23:22:03.061123 17846 catalog_manager.cc:4841] TS 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417): tablet 672c4f4ac14748d3aa60e274ed7b3a56 (table test-table [id=789d9222c518454f959e6b70bc9bb838]) successfully deleted
I20260809 23:22:03.061302 17847 catalog_manager.cc:4841] TS 27b74a856b4449e2af5b7b04f77af46c (127.1.235.131:44575): tablet 672c4f4ac14748d3aa60e274ed7b3a56 (table test-table [id=789d9222c518454f959e6b70bc9bb838]) successfully deleted
W20260809 23:22:03.063687 17845 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.235.129:37697 (error 108)
I20260809 23:22:03.064021 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 18068
I20260809 23:22:03.070185 18069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:03.070013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:37697 (local address 127.0.0.1:33728)
0809 23:22:03.070082 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:03.070140 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.129:37697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 23:22:03.070551 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 18217
W20260809 23:22:03.070374 17845 catalog_manager.cc:4584] TS ca774ea32fdf4ea1b731ae428c29db75 (127.1.235.129:37697): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 672c4f4ac14748d3aa60e274ed7b3a56: Network error: Client connection negotiation failed: client connection to 127.1.235.129:37697: connect: Connection refused (error 111)
I20260809 23:22:03.076459 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 17825
I20260809 23:22:03.083256 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:39419
--webserver_interface=127.1.235.190
--webserver_port=39075
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:39419
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:22:03.160645 18397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:03.160892 18397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:03.160931 18397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:03.162074 18397 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:22:03.162143 18397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:03.162178 18397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:03.162217 18397 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:22:03.162243 18397 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:22:03.163686 18397 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:39419
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:39419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=39075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:03.163957 18397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:03.164181 18397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:03.169137 18403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:03.169150 18404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:03.169167 18397 server_base.cc:1034] running on GCE node
W20260809 23:22:03.169153 18406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:03.169545 18397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:03.169869 18397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:03.171031 18397 hybrid_clock.cc:648] HybridClock initialized: now 1786317723171027 us; error 37 us; skew 500 ppm
Aug 09 23:22:03 dist-test-slave-6nmv krb5kdc[17218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317723, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:03.173533 18397 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:22:03.174010 18397 webserver.cc:460] Webserver started at http://127.1.235.190:39075/ using document root <none> and password file <none>
I20260809 23:22:03.174224 18397 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:03.174290 18397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:03.175519 18397 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:22:03.176229 18413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:03.176399 18397 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:22:03.176497 18397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "4065be1872104ddbb008d818e955c8fa"
format_stamp: "Formatted at 2026-08-09 23:22:01 on dist-test-slave-6nmv"
server_key: "9ce606a3b00878f42592b16b5d0c4428"
server_key_iv: "b701c52623cd8bf743c39f6fd6090c1f"
server_key_version: "encryptionkey@0"
I20260809 23:22:03.176828 18397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:03.198861 18397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:03.200347 18397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:03.200484 18397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:03.204141 18397 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:39419
I20260809 23:22:03.204188 18471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:39419 every 8 connection(s)
I20260809 23:22:03.204523 18397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:22:03.205909 18472 sys_catalog.cc:263] Verifying existing consensus state
I20260809 23:22:03.206543 18472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa: Bootstrap starting.
I20260809 23:22:03.208200 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 18397
I20260809 23:22:03.208485 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:37697
--local_ip_for_outbound_sockets=127.1.235.129
--tserver_master_addrs=127.1.235.190:39419
--webserver_port=45387
--webserver_interface=127.1.235.129
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:22:03.215582 18472 log.cc:824] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:03.217621 18472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 23:22:03.217949 18472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa: Bootstrap complete.
I20260809 23:22:03.219966 18472 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } }
I20260809 23:22:03.220177 18472 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4065be1872104ddbb008d818e955c8fa, State: Initialized, Role: FOLLOWER
I20260809 23:22:03.220359 18472 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } }
I20260809 23:22:03.220456 18472 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:22:03.220505 18472 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:22:03.220568 18472 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 2 FOLLOWER]: Advancing to term 3
I20260809 23:22:03.221474 18472 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } }
I20260809 23:22:03.221581 18472 leader_election.cc:302] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4065be1872104ddbb008d818e955c8fa; no voters:
I20260809 23:22:03.221773 18472 leader_election.cc:288] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 23:22:03.221858 18478 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 3 FOLLOWER]: Leader election won for term 3
I20260809 23:22:03.221975 18478 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [term 3 LEADER]: Becoming Leader. State: Replica: 4065be1872104ddbb008d818e955c8fa, State: Running, Role: LEADER
I20260809 23:22:03.222046 18472 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:22:03.222060 18478 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } }
I20260809 23:22:03.222325 18478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4065be1872104ddbb008d818e955c8fa. Latest consensus state: current_term: 3 leader_uuid: "4065be1872104ddbb008d818e955c8fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } } }
I20260809 23:22:03.222397 18478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [sys.catalog]: This master's current role is: LEADER
I20260809 23:22:03.222607 18484 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:22:03.222549 18479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "4065be1872104ddbb008d818e955c8fa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4065be1872104ddbb008d818e955c8fa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 39419 } } }
I20260809 23:22:03.222755 18479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4065be1872104ddbb008d818e955c8fa [sys.catalog]: This master's current role is: LEADER
I20260809 23:22:03.226341 18484 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:22:03.226464 18484 catalog_manager.cc:1259] Loaded cluster ID: 4702505dbd874d7ab403df70d8363e7a
I20260809 23:22:03.226505 18484 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 23:22:03.226871 18484 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f1a2d5dd9ad google::LogMessage::Fail() at ??:0
@ 0x7f1a2d5e088a google::LogMessage::SendToLog() at ??:0
@ 0x7f1a2d5dd4de google::LogMessage::Flush() at ??:0
@ 0x7f1a2d5dea19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f1a354fe0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f1a355078b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f1a2f4ab0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f1a2f4a0954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f1a303046db start_thread at ??:0
@ 0x7f1a2c0db61f clone at ??:0
W20260809 23:22:03.316692 18475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:03.316998 18475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:03.317035 18475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:03.318646 18475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:03.318723 18475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:03.318763 18475 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:22:03.320828 18475 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:37697
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=45387
--tserver_master_addrs=127.1.235.190:39419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18475
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:03.321036 18475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:03.321266 18475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:03.326304 18518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:03.326275 18516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:03.326570 18520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:03.326612 18475 server_base.cc:1034] running on GCE node
I20260809 23:22:03.326799 18475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:03.327064 18475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:03.328246 18475 hybrid_clock.cc:648] HybridClock initialized: now 1786317723328233 us; error 31 us; skew 500 ppm
Aug 09 23:22:03 dist-test-slave-6nmv krb5kdc[17218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317723, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:03.330727 18475 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:22:03.331121 18475 webserver.cc:460] Webserver started at http://127.1.235.129:45387/ using document root <none> and password file <none>
I20260809 23:22:03.331349 18475 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:03.331418 18475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:03.332777 18475 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:22:03.333567 18528 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:03.333745 18475 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:22:03.333846 18475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "ca774ea32fdf4ea1b731ae428c29db75"
format_stamp: "Formatted at 2026-08-09 23:22:01 on dist-test-slave-6nmv"
server_key: "05ad13c00b63dca5dc4867e707aa90af"
server_key_iv: "974da1b661a4b2a74389d1aa4755234c"
server_key_version: "encryptionkey@0"
I20260809 23:22:03.334239 18475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:03.371695 18475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:03.374316 18475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:03.374487 18475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:03.374784 18475 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:22:03.375316 18535 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 23:22:03.376806 18475 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 23:22:03.376888 18475 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 23:22:03.376929 18475 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 23:22:03.377882 18475 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 23:22:03.377938 18475 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.001s
I20260809 23:22:03.377995 18535 tablet_bootstrap.cc:492] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75: Bootstrap starting.
I20260809 23:22:03.379273 18535 log.cc:824] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:03.382143 18535 tablet_bootstrap.cc:492] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 23:22:03.382463 18535 tablet_bootstrap.cc:492] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75: Bootstrap complete.
I20260809 23:22:03.382613 18535 ts_tablet_manager.cc:1397] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 23:22:03.384433 18535 raft_consensus.cc:348] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } }
I20260809 23:22:03.384801 18535 raft_consensus.cc:729] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca774ea32fdf4ea1b731ae428c29db75, State: Initialized, Role: FOLLOWER
I20260809 23:22:03.384953 18535 consensus_queue.cc:260] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } }
I20260809 23:22:03.385217 18535 ts_tablet_manager.cc:1428] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:22:03.386245 18475 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:37697
I20260809 23:22:03.386273 18657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:37697 every 8 connection(s)
I20260809 23:22:03.386636 18475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:22:03.395552 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 18475
I20260809 23:22:03.395880 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:35417
--local_ip_for_outbound_sockets=127.1.235.130
--tserver_master_addrs=127.1.235.190:39419
--webserver_port=43665
--webserver_interface=127.1.235.130
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:22:03.450982 18660 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:22:03.387401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:42137)
0809 23:22:03.387560 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:03.387593 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:03.387709 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:03.450769 (+ 63060us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
W20260809 23:22:03.451196 18658 heartbeater.cc:644] Failed to heartbeat to 127.1.235.190:39419 (0 consecutive failures): Network error: Failed to ping master at 127.1.235.190:39419: Client connection negotiation failed: client connection to 127.1.235.190:39419: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 23:22:03.451552 18660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:03.451411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:60015)
0809 23:22:03.451482 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:03.451525 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 23:22:03.451908 18660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:03.451822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:33231)
0809 23:22:03.451865 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:03.451888 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260809 23:22:03.452062 18658 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 23:22:03.477236 18661 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:03.477416 18661 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:03.477442 18661 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:03.478521 18661 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:03.478561 18661 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:03.478585 18661 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:22:03.480091 18661 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:35417
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=43665
--tserver_master_addrs=127.1.235.190:39419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18661
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:03.480319 18661 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:03.480576 18661 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:03.485061 18671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:03.485070 18669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:03.485080 18667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:03.485203 18661 server_base.cc:1034] running on GCE node
I20260809 23:22:03.485387 18661 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:03.485648 18661 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:03.486829 18661 hybrid_clock.cc:648] HybridClock initialized: now 1786317723486805 us; error 40 us; skew 500 ppm
Aug 09 23:22:03 dist-test-slave-6nmv krb5kdc[17218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317723, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:03.489198 18661 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:22:03.489624 18661 webserver.cc:460] Webserver started at http://127.1.235.130:43665/ using document root <none> and password file <none>
I20260809 23:22:03.489784 18661 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:03.489879 18661 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:03.491025 18661 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:22:03.491541 18680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:03.491855 18661 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:22:03.491956 18661 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "3b993b0a2ee8427baa3e952bece61404"
format_stamp: "Formatted at 2026-08-09 23:22:01 on dist-test-slave-6nmv"
server_key: "7f56faa63bed90b9c10a3f3e4c92ad23"
server_key_iv: "62499ff38d352fa9a2eda61e3a2a53d6"
server_key_version: "encryptionkey@0"
I20260809 23:22:03.492249 18661 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:03.505903 18661 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:03.507997 18661 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:03.508141 18661 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:03.508332 18661 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:22:03.508597 18661 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:22:03.508649 18661 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:03.508683 18661 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:22:03.508708 18661 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:03.514459 18661 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:35417
I20260809 23:22:03.514508 18804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:35417 every 8 connection(s)
I20260809 23:22:03.514796 18661 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:22:03.515751 18809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:03.515383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:36169)
0809 23:22:03.515521 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:03.515584 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":70,"threads_started":1}
W20260809 23:22:03.516116 18805 heartbeater.cc:644] Failed to heartbeat to 127.1.235.190:39419 (0 consecutive failures): Network error: Failed to ping master at 127.1.235.190:39419: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
I20260809 23:22:03.516386 18809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:03.516297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:38631)
0809 23:22:03.516341 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:03.516368 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 23:22:03.516633 18809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:03.516584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:53549)
0809 23:22:03.516604 (+ 20us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:03.516622 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260809 23:22:03.516738 18805 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 23:22:03.521270 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 18661
I20260809 23:22:03.521471 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:44575
--local_ip_for_outbound_sockets=127.1.235.131
--tserver_master_addrs=127.1.235.190:39419
--webserver_port=36661
--webserver_interface=127.1.235.131
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:22:03.600358 18811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:03.600576 18811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:03.600611 18811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:03.601673 18811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:03.601734 18811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:03.601775 18811 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:22:03.603219 18811 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:44575
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=36661
--tserver_master_addrs=127.1.235.190:39419
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18811
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:03.603497 18811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:03.603721 18811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:03.608472 18817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:03.608526 18816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:03.608711 18811 server_base.cc:1034] running on GCE node
W20260809 23:22:03.608485 18819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:03.608971 18811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:03.609200 18811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:03.610359 18811 hybrid_clock.cc:648] HybridClock initialized: now 1786317723610350 us; error 32 us; skew 500 ppm
Aug 09 23:22:03 dist-test-slave-6nmv krb5kdc[17218](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317723, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:03.612933 18811 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:22:03.613322 18811 webserver.cc:460] Webserver started at http://127.1.235.131:36661/ using document root <none> and password file <none>
I20260809 23:22:03.613543 18811 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:03.613587 18811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:03.614830 18811 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:22:03.615382 18826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:03.615561 18811 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:22:03.615628 18811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "27b74a856b4449e2af5b7b04f77af46c"
format_stamp: "Formatted at 2026-08-09 23:22:02 on dist-test-slave-6nmv"
server_key: "ca063fcbd89f99af20e5755e3c4bf849"
server_key_iv: "667e32d12705f62b183ad28fb3befb48"
server_key_version: "encryptionkey@0"
I20260809 23:22:03.615958 18811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:03.658125 18811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:03.660051 18811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:03.660195 18811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:03.660449 18811 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:22:03.660779 18811 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:22:03.660835 18811 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:03.660874 18811 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:22:03.660909 18811 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:03.666536 18811 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:44575
I20260809 23:22:03.666591 18953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:44575 every 8 connection(s)
I20260809 23:22:03.666925 18811 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:22:03.667848 18957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:03.667516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:60779)
0809 23:22:03.667662 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:03.667724 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":76,"threads_started":1}
W20260809 23:22:03.668206 18954 heartbeater.cc:644] Failed to heartbeat to 127.1.235.190:39419 (0 consecutive failures): Network error: Failed to ping master at 127.1.235.190:39419: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
I20260809 23:22:03.668438 18957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:03.668376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:41621)
0809 23:22:03.668400 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:03.668424 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
I20260809 23:22:03.668658 18957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:03.668614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:37643)
0809 23:22:03.668632 (+ 18us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:03.668648 (+ 16us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260809 23:22:03.668766 18954 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 23:22:03.677032 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 18811
I20260809 23:22:04.452694 18960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:04.452430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:43883)
0809 23:22:04.452595 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:04.452628 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":109,"threads_started":1}
I20260809 23:22:04.517208 18961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:04.517039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:60755)
0809 23:22:04.517141 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:04.517170 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":51,"threads_started":1}
I20260809 23:22:04.669225 18962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:04.669029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:38029)
0809 23:22:04.669149 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:04.669179 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":64,"threads_started":1}
I20260809 23:22:05.157922 18963 raft_consensus.cc:482] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:22:05.158043 18963 raft_consensus.cc:504] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } }
I20260809 23:22:05.158428 18963 leader_election.cc:288] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417), 27b74a856b4449e2af5b7b04f77af46c (127.1.235.131:44575)
Aug 09 23:22:05 dist-test-slave-6nmv krb5kdc[17218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317723, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.131@KRBTEST.COM
Aug 09 23:22:05 dist-test-slave-6nmv krb5kdc[17218](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317723, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.130@KRBTEST.COM
I20260809 23:22:05.171264 18966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:05.158733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:41855 (local address 127.1.235.131:44575)
0809 23:22:05.158951 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:05.158958 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:05.158996 (+ 38us) server_negotiation.cc:407] Connection header received
0809 23:22:05.159565 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:05.159568 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:05.159618 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:05.159772 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:05.161072 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:05.162333 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:05.163961 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:05.164567 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:05.164677 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:05.167518 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:05.167522 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:05.167523 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:05.167535 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:05.169469 (+ 1934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:05.170092 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:05.170095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:05.170095 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:05.170183 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:05.170442 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:05.170443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:05.170444 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:05.170668 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:05.170763 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:05.171058 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 23:22:05.171173 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":67,"threads_started":1}
I20260809 23:22:05.171275 18964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:05.158602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:35417 (local address 127.1.235.129:35075)
0809 23:22:05.158768 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:05.158780 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:05.158842 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:05.159888 (+ 1046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:05.159891 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:05.160453 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:22:05.160781 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:05.160790 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:05.162471 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:05.162472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:05.163849 (+ 1377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:05.163852 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:05.164680 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:05.164681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:05.164830 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:05.165488 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:22:05.165500 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:22:05.167772 (+ 2272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:22:05.169687 (+ 1915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:05.169688 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:05.169688 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:05.169996 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:05.170241 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:05.170242 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:05.170243 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:05.170346 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:05.170734 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:22:05.170741 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:22:05.170870 (+ 129us) client_negotiation.cc:769] Sending connection context
0809 23:22:05.170959 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 23:22:05.171165 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":81,"thread_start_us":56,"threads_started":1}
I20260809 23:22:05.171334 18967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:05.158785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:35075 (local address 127.1.235.130:35417)
0809 23:22:05.158945 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:05.158958 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:05.158987 (+ 29us) server_negotiation.cc:407] Connection header received
0809 23:22:05.159559 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:05.159562 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:05.159618 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:05.159772 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:05.160929 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:05.162333 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:05.163961 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:05.164567 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:05.164674 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:05.167900 (+ 3226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:05.167904 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:05.167904 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:05.167918 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:05.169560 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:05.170071 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:05.170075 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:05.170075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:05.170174 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:05.170410 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:05.170412 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:05.170412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:05.170640 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:05.170750 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:05.171045 (+ 295us) server_negotiation.cc:299] Negotiation successful
0809 23:22:05.171213 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":56,"threads_started":1}
I20260809 23:22:05.172101 18965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:05.158602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:44575 (local address 127.1.235.129:41855)
0809 23:22:05.158729 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:05.158742 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:05.158812 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:05.159888 (+ 1076us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:05.159891 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:05.160453 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:22:05.160968 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:05.160970 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:05.162486 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:05.162486 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:05.163849 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:05.163852 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:05.164682 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:05.164683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:05.164830 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:05.165653 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:22:05.165658 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:22:05.167378 (+ 1720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:22:05.169556 (+ 2178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:05.169592 (+ 36us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:05.169594 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:05.169997 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:05.170269 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:05.170270 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:05.170270 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:05.170353 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:05.170765 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:22:05.170766 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:22:05.170874 (+ 108us) client_negotiation.cc:769] Sending connection context
0809 23:22:05.170990 (+ 116us) client_negotiation.cc:240] Negotiation successful
0809 23:22:05.171228 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":212,"thread_start_us":60,"threads_started":1}
W20260809 23:22:05.172382 18531 leader_election.cc:341] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417): Not found: Tablet not found: 672c4f4ac14748d3aa60e274ed7b3a56
W20260809 23:22:05.172837 18532 leader_election.cc:341] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 27b74a856b4449e2af5b7b04f77af46c (127.1.235.131:44575): Not found: Tablet not found: 672c4f4ac14748d3aa60e274ed7b3a56
I20260809 23:22:05.172919 18532 leader_election.cc:302] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca774ea32fdf4ea1b731ae428c29db75; no voters: 27b74a856b4449e2af5b7b04f77af46c, 3b993b0a2ee8427baa3e952bece61404
I20260809 23:22:05.173026 18963 raft_consensus.cc:2726] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:22:05.453423 18965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:05.453297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:57111)
0809 23:22:05.453344 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:05.453375 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 23:22:05.517925 18968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:05.517636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:58231)
0809 23:22:05.517785 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:05.517867 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":99,"threads_started":1}
I20260809 23:22:05.669966 18969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:05.669689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:35449)
0809 23:22:05.669885 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:05.669921 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":94,"threads_started":1}
I20260809 23:22:06.454110 18970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:06.453917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:54689)
0809 23:22:06.454034 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:06.454067 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":60,"threads_started":1}
I20260809 23:22:06.518518 18971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:06.518312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:37301)
0809 23:22:06.518443 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:06.518478 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":89,"threads_started":1}
I20260809 23:22:06.670591 18972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:06.670389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:44153)
0809 23:22:06.670519 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:06.670552 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":62,"threads_started":1}
I20260809 23:22:06.736192 18973 raft_consensus.cc:482] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:22:06.736284 18973 raft_consensus.cc:504] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } }
I20260809 23:22:06.736521 18973 leader_election.cc:288] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417), 27b74a856b4449e2af5b7b04f77af46c (127.1.235.131:44575)
W20260809 23:22:06.736997 18532 leader_election.cc:341] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 27b74a856b4449e2af5b7b04f77af46c (127.1.235.131:44575): Not found: Tablet not found: 672c4f4ac14748d3aa60e274ed7b3a56
W20260809 23:22:06.737067 18531 leader_election.cc:341] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417): Not found: Tablet not found: 672c4f4ac14748d3aa60e274ed7b3a56
I20260809 23:22:06.737104 18531 leader_election.cc:302] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca774ea32fdf4ea1b731ae428c29db75; no voters: 27b74a856b4449e2af5b7b04f77af46c, 3b993b0a2ee8427baa3e952bece61404
I20260809 23:22:06.737191 18973 raft_consensus.cc:2726] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:22:07.454761 18974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:07.454528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:48629)
0809 23:22:07.454681 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:07.454714 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":69,"threads_started":1}
I20260809 23:22:07.519186 18975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:07.518967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:57605)
0809 23:22:07.519079 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:07.519126 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":51,"threads_started":1}
I20260809 23:22:07.671335 18976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:07.671133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:56149)
0809 23:22:07.671264 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:07.671298 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":60,"threads_started":1}
I20260809 23:22:08.455459 18977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:08.455217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:57731)
0809 23:22:08.455375 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:08.455412 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":74,"threads_started":1}
I20260809 23:22:08.519760 18978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:08.519579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:34541)
0809 23:22:08.519694 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:08.519725 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":53,"threads_started":1}
I20260809 23:22:08.672049 18979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:08.671861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:40153)
0809 23:22:08.671986 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:08.672013 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":78,"threads_started":1}
I20260809 23:22:09.406827 18980 raft_consensus.cc:482] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:22:09.406932 18980 raft_consensus.cc:504] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } }
I20260809 23:22:09.407120 18980 leader_election.cc:288] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417), 27b74a856b4449e2af5b7b04f77af46c (127.1.235.131:44575)
W20260809 23:22:09.407505 18531 leader_election.cc:341] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417): Not found: Tablet not found: 672c4f4ac14748d3aa60e274ed7b3a56
W20260809 23:22:09.407701 18532 leader_election.cc:341] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 27b74a856b4449e2af5b7b04f77af46c (127.1.235.131:44575): Not found: Tablet not found: 672c4f4ac14748d3aa60e274ed7b3a56
I20260809 23:22:09.407752 18532 leader_election.cc:302] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca774ea32fdf4ea1b731ae428c29db75; no voters: 27b74a856b4449e2af5b7b04f77af46c, 3b993b0a2ee8427baa3e952bece61404
I20260809 23:22:09.407816 18980 raft_consensus.cc:2726] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:22:09.456090 18981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:09.455899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:49155)
0809 23:22:09.456016 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:09.456046 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":59,"threads_started":1}
I20260809 23:22:09.520356 18982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:09.520146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:45143)
0809 23:22:09.520279 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:09.520308 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
I20260809 23:22:09.672701 18983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:09.672495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:40113)
0809 23:22:09.672630 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:09.672661 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":77,"threads_started":1}
I20260809 23:22:10.456795 18984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:10.456560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:45619)
0809 23:22:10.456712 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:10.456749 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":65,"threads_started":1}
I20260809 23:22:10.520922 18985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:10.520746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:53349)
0809 23:22:10.520856 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:10.520885 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":57,"threads_started":1}
I20260809 23:22:10.673343 18986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:10.673138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:42069)
0809 23:22:10.673274 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:10.673306 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":79,"threads_started":1}
I20260809 23:22:11.138904 18987 raft_consensus.cc:482] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:22:11.139008 18987 raft_consensus.cc:504] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } }
I20260809 23:22:11.139230 18987 leader_election.cc:288] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417), 27b74a856b4449e2af5b7b04f77af46c (127.1.235.131:44575)
W20260809 23:22:11.139681 18531 leader_election.cc:341] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417): Not found: Tablet not found: 672c4f4ac14748d3aa60e274ed7b3a56
W20260809 23:22:11.139788 18532 leader_election.cc:341] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 27b74a856b4449e2af5b7b04f77af46c (127.1.235.131:44575): Not found: Tablet not found: 672c4f4ac14748d3aa60e274ed7b3a56
I20260809 23:22:11.139849 18532 leader_election.cc:302] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca774ea32fdf4ea1b731ae428c29db75; no voters: 27b74a856b4449e2af5b7b04f77af46c, 3b993b0a2ee8427baa3e952bece61404
I20260809 23:22:11.139950 18987 raft_consensus.cc:2726] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:22:11.457551 18988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:11.457305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:53357)
0809 23:22:11.457465 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:11.457502 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":100,"threads_started":1}
I20260809 23:22:11.521512 18989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:11.521329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:59755)
0809 23:22:11.521443 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:11.521473 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":67,"threads_started":1}
I20260809 23:22:11.674028 18990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:11.673796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:44625)
0809 23:22:11.673963 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:11.673992 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":118,"threads_started":1}
I20260809 23:22:12.458259 18991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:12.458039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:37743)
0809 23:22:12.458177 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:12.458212 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":64,"threads_started":1}
I20260809 23:22:12.522297 18992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:12.522093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:38291)
0809 23:22:12.522219 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:12.522256 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":64,"threads_started":1}
I20260809 23:22:12.674675 18993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:12.674477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:56333)
0809 23:22:12.674602 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:12.674635 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":67,"threads_started":1}
I20260809 23:22:13.458907 18994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:13.458682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:54567)
0809 23:22:13.458820 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:13.458858 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":64,"threads_started":1}
I20260809 23:22:13.523098 18995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:13.522860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:46821)
0809 23:22:13.523035 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:13.523065 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":118,"threads_started":1}
I20260809 23:22:13.675215 18996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:13.675057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:50513)
0809 23:22:13.675155 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:13.675184 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":51,"threads_started":1}
I20260809 23:22:14.459571 18997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:14.459368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:55371)
0809 23:22:14.459493 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:14.459527 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":68,"threads_started":1}
I20260809 23:22:14.523936 18998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:14.523686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:45897)
0809 23:22:14.523836 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:14.523873 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":86,"threads_started":1}
I20260809 23:22:14.675788 18999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:14.675608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:44971)
0809 23:22:14.675720 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:14.675751 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":59,"threads_started":1}
I20260809 23:22:15.460242 19000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:15.460039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:49859)
0809 23:22:15.460166 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:15.460195 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":58,"threads_started":1}
I20260809 23:22:15.524523 19001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:15.524333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:44135)
0809 23:22:15.524454 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:15.524483 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":68,"threads_started":1}
I20260809 23:22:15.676452 19002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:15.676243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:37629)
0809 23:22:15.676369 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:15.676416 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":59,"threads_started":1}
I20260809 23:22:16.460901 19003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:16.460692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:59079)
0809 23:22:16.460820 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:16.460852 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":61,"threads_started":1}
I20260809 23:22:16.525121 19004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:16.524910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:51999)
0809 23:22:16.525049 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:16.525082 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":84,"threads_started":1}
I20260809 23:22:16.677143 19005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:16.676928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:47521)
0809 23:22:16.677072 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:16.677103 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":92,"threads_started":1}
I20260809 23:22:17.048537 19006 raft_consensus.cc:482] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:22:17.048631 19006 raft_consensus.cc:504] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b993b0a2ee8427baa3e952bece61404" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35417 } } peers { permanent_uuid: "27b74a856b4449e2af5b7b04f77af46c" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 44575 } } peers { permanent_uuid: "ca774ea32fdf4ea1b731ae428c29db75" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37697 } }
I20260809 23:22:17.048810 19006 leader_election.cc:288] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417), 27b74a856b4449e2af5b7b04f77af46c (127.1.235.131:44575)
W20260809 23:22:17.049192 18531 leader_election.cc:341] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3b993b0a2ee8427baa3e952bece61404 (127.1.235.130:35417): Not found: Tablet not found: 672c4f4ac14748d3aa60e274ed7b3a56
W20260809 23:22:17.049283 18532 leader_election.cc:341] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 27b74a856b4449e2af5b7b04f77af46c (127.1.235.131:44575): Not found: Tablet not found: 672c4f4ac14748d3aa60e274ed7b3a56
I20260809 23:22:17.049367 18532 leader_election.cc:302] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ca774ea32fdf4ea1b731ae428c29db75; no voters: 27b74a856b4449e2af5b7b04f77af46c, 3b993b0a2ee8427baa3e952bece61404
I20260809 23:22:17.049451 19006 raft_consensus.cc:2726] T 672c4f4ac14748d3aa60e274ed7b3a56 P ca774ea32fdf4ea1b731ae428c29db75 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:22:17.461536 19007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:17.461328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:56315)
0809 23:22:17.461459 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:17.461490 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":79,"threads_started":1}
I20260809 23:22:17.525691 19008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:17.525501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:39737)
0809 23:22:17.525618 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:17.525651 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
I20260809 23:22:17.677772 19009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:17.677559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:54007)
0809 23:22:17.677699 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:17.677732 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":61,"threads_started":1}
I20260809 23:22:18.462296 19010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:18.462082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.129:43481)
0809 23:22:18.462219 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:18.462251 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":62,"threads_started":1}
I20260809 23:22:18.526454 19011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:18.526199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.130:39419)
0809 23:22:18.526331 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:18.526377 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":74,"threads_started":1}
I20260809 23:22:18.678493 19012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:18.678291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:39419 (local address 127.1.235.131:46355)
0809 23:22:18.678421 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:18.678457 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:39419: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":75,"threads_started":1}
I20260809 23:22:18.685140 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 18475
I20260809 23:22:18.693024 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 18661
I20260809 23:22:18.700222 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 18811
2026-08-09T23:22:18Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18248 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:22:18 dist-test-slave-6nmv krb5kdc[19015](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:22:18 dist-test-slave-6nmv krb5kdc[19015](info): set up 2 sockets
Aug 09 23:22:18 dist-test-slave-6nmv krb5kdc[19015](info): commencing operation
krb5kdc: starting...
W20260809 23:22:19.737283 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.017s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:22:19 dist-test-slave-6nmv krb5kdc[19015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317739, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:22:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:22:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:22:19.852057 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:38991
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:38991
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:22:19.927301 19031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:19.927501 19031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:19.927531 19031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:19.928581 19031 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 23:22:19.928614 19031 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 23:22:19.928627 19031 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 23:22:19.928639 19031 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:22:19.928653 19031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:19.928666 19031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:19.928690 19031 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:22:19.928702 19031 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:22:19.930140 19031 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:38991
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:38991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:19.930310 19031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:19.930470 19031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:19.935190 19036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:19.935205 19039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:19.935213 19037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:19.935235 19031 server_base.cc:1034] running on GCE node
I20260809 23:22:19.935730 19031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:19.936004 19031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:19.937167 19031 hybrid_clock.cc:648] HybridClock initialized: now 1786317739937142 us; error 56 us; skew 500 ppm
Aug 09 23:22:19 dist-test-slave-6nmv krb5kdc[19015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317739, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:19.939621 19031 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:22:19.940068 19031 webserver.cc:460] Webserver started at http://127.1.235.190:36325/ using document root <none> and password file <none>
I20260809 23:22:19.940304 19031 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:19.940371 19031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:19.940526 19031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:22:19.941565 19031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "e4d711b336ca4de6b485147f053fcf4e"
format_stamp: "Formatted at 2026-08-09 23:22:19 on dist-test-slave-6nmv"
server_key: "fd95cfb7c6c403a760038c792dce42c1"
server_key_iv: "493b7507417924de67a8dca61a1b2d35"
server_key_version: "encryptionkey@0"
I20260809 23:22:19.941956 19031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "e4d711b336ca4de6b485147f053fcf4e"
format_stamp: "Formatted at 2026-08-09 23:22:19 on dist-test-slave-6nmv"
server_key: "fd95cfb7c6c403a760038c792dce42c1"
server_key_iv: "493b7507417924de67a8dca61a1b2d35"
server_key_version: "encryptionkey@0"
I20260809 23:22:19.943223 19031 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:22:19.943858 19046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:19.944020 19031 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:22:19.944118 19031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "e4d711b336ca4de6b485147f053fcf4e"
format_stamp: "Formatted at 2026-08-09 23:22:19 on dist-test-slave-6nmv"
server_key: "fd95cfb7c6c403a760038c792dce42c1"
server_key_iv: "493b7507417924de67a8dca61a1b2d35"
server_key_version: "encryptionkey@0"
I20260809 23:22:19.944190 19031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:19.970738 19031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:19.972695 19031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:19.972870 19031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:19.977144 19031 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:38991
I20260809 23:22:19.977180 19103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:38991 every 8 connection(s)
I20260809 23:22:19.977560 19031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:22:19.978466 19104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:22:19.980677 19104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: Bootstrap starting.
I20260809 23:22:19.981245 19104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: Neither blocks nor log segments found. Creating new log.
I20260809 23:22:19.981526 19104 log.cc:824] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:19.982220 19104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: No bootstrap required, opened a new log
I20260809 23:22:19.983701 19104 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } }
I20260809 23:22:19.983831 19104 raft_consensus.cc:374] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:22:19.983852 19104 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4d711b336ca4de6b485147f053fcf4e, State: Initialized, Role: FOLLOWER
I20260809 23:22:19.983945 19104 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } }
I20260809 23:22:19.984037 19104 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:22:19.984081 19104 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:22:19.984148 19104 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:22:19.984707 19104 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } }
I20260809 23:22:19.984822 19104 leader_election.cc:302] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4d711b336ca4de6b485147f053fcf4e; no voters:
I20260809 23:22:19.985021 19104 leader_election.cc:288] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:22:19.985059 19109 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:22:19.985212 19109 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 1 LEADER]: Becoming Leader. State: Replica: e4d711b336ca4de6b485147f053fcf4e, State: Running, Role: LEADER
I20260809 23:22:19.985285 19104 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:22:19.985349 19109 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } }
I20260809 23:22:19.985721 19110 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e4d711b336ca4de6b485147f053fcf4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } } }
I20260809 23:22:19.985880 19110 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [sys.catalog]: This master's current role is: LEADER
I20260809 23:22:19.985725 19111 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4d711b336ca4de6b485147f053fcf4e. Latest consensus state: current_term: 1 leader_uuid: "e4d711b336ca4de6b485147f053fcf4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } } }
I20260809 23:22:19.986131 19111 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [sys.catalog]: This master's current role is: LEADER
I20260809 23:22:19.986327 19115 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:22:19.986435 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 19031
I20260809 23:22:19.986562 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:22:19.986814 1966 external_mini_cluster.cc:1428] Setting key d7bfe59decee298d4a29a65307e468eb
I20260809 23:22:19.986932 19115 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:22:19.988574 19115 catalog_manager.cc:1347] Generated new cluster ID: 7c6931eddbd04bb592a8a7bd8d8aa519
I20260809 23:22:19.988626 19115 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 23:22:19 dist-test-slave-6nmv krb5kdc[19015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317739, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:22:19.998567 19131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:19.987468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58012 (local address 127.1.235.190:38991)
0809 23:22:19.987682 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:19.987691 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:19.987997 (+ 306us) server_negotiation.cc:407] Connection header received
0809 23:22:19.988137 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:19.988144 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:19.988203 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:19.988336 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:19.989093 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:19.990437 (+ 1344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:19.991446 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:19.992107 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:19.992219 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:19.995007 (+ 2788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:19.995011 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:19.995011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:19.995023 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:19.996863 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:19.997302 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:19.997305 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:19.997305 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:19.997407 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:19.997625 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:19.997626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:19.997626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:19.997919 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:19.998046 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:19.998174 (+ 128us) server_negotiation.cc:299] Negotiation successful
0809 23:22:19.998302 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":90,"threads_started":1}
I20260809 23:22:20.010800 19115 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:22:20.011407 19115 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:22:20.015479 19115 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: Generated new TSK 0
I20260809 23:22:20.015662 19115 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:22:20.050398 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:38991
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:22:20.133522 19135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:20.133719 19135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:20.133744 19135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:20.134950 19135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:20.134991 19135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:20.135017 19135 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:22:20.136389 19135 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:38991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19135
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:20.136569 19135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:20.136735 19135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:20.141625 19140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:20.141633 19143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:20.141628 19141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:20.141885 19135 server_base.cc:1034] running on GCE node
I20260809 23:22:20.142140 19135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:20.142390 19135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:20.143558 19135 hybrid_clock.cc:648] HybridClock initialized: now 1786317740143549 us; error 41 us; skew 500 ppm
Aug 09 23:22:20 dist-test-slave-6nmv krb5kdc[19015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317740, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:20.146031 19135 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:22:20.146540 19135 webserver.cc:460] Webserver started at http://127.1.235.129:34251/ using document root <none> and password file <none>
I20260809 23:22:20.146799 19135 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:20.146867 19135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:20.147032 19135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:22:20.148116 19135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "faa3bfc9fb31464e844af7555da8f0d8"
format_stamp: "Formatted at 2026-08-09 23:22:20 on dist-test-slave-6nmv"
server_key: "4e0579aed8d9e58e06a17411303eb6f1"
server_key_iv: "fa892f9cb2c875e3231d27287dedd826"
server_key_version: "encryptionkey@0"
I20260809 23:22:20.148473 19135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "faa3bfc9fb31464e844af7555da8f0d8"
format_stamp: "Formatted at 2026-08-09 23:22:20 on dist-test-slave-6nmv"
server_key: "4e0579aed8d9e58e06a17411303eb6f1"
server_key_iv: "fa892f9cb2c875e3231d27287dedd826"
server_key_version: "encryptionkey@0"
I20260809 23:22:20.149785 19135 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:22:20.150583 19151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:20.150763 19135 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:22:20.150862 19135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "faa3bfc9fb31464e844af7555da8f0d8"
format_stamp: "Formatted at 2026-08-09 23:22:20 on dist-test-slave-6nmv"
server_key: "4e0579aed8d9e58e06a17411303eb6f1"
server_key_iv: "fa892f9cb2c875e3231d27287dedd826"
server_key_version: "encryptionkey@0"
I20260809 23:22:20.150965 19135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:20.160214 19135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:20.161988 19135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:20.162153 19135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:20.162390 19135 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:22:20.162689 19135 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:22:20.162745 19135 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:20.162781 19135 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:22:20.162806 19135 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:20.168722 19135 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:44037
I20260809 23:22:20.168773 19277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:44037 every 8 connection(s)
I20260809 23:22:20.169070 19135 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
Aug 09 23:22:20 dist-test-slave-6nmv krb5kdc[19015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317740, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:22:20.175415 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 19135
I20260809 23:22:20.175534 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:22:20.175772 1966 external_mini_cluster.cc:1428] Setting key 642f5384f2f3cfa42c8b5e3b1a149cdb
I20260809 23:22:20.177992 19131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.169703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:49343 (local address 127.1.235.190:38991)
0809 23:22:20.169745 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:20.169746 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:20.169945 (+ 199us) server_negotiation.cc:407] Connection header received
0809 23:22:20.170384 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:20.170385 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:20.170396 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:20.170447 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:20.171243 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.171756 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.172728 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.172935 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.172984 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.174948 (+ 1964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:20.174950 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:20.174950 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:20.174959 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:20.176596 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:20.176994 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:20.176995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:20.176996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:20.177052 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:20.177329 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:20.177330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:20.177331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:20.177455 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:20.177528 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:20.177791 (+ 263us) server_negotiation.cc:299] Negotiation successful
0809 23:22:20.177904 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:22:20.178175 19280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.169652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:49343)
0809 23:22:20.169824 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:20.169864 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:20.170307 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:20.170505 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:20.170508 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:20.170995 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:22:20.171155 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:20.171159 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.171879 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.171880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:20.172652 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:20.172654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.173005 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.173005 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:20.173093 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.173505 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:22:20.173512 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:22:20.174865 (+ 1353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:22:20.176681 (+ 1816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:20.176688 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:20.176690 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:20.176897 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:20.177142 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:20.177147 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:20.177148 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:20.177249 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:20.177534 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:22:20.177541 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:22:20.177660 (+ 119us) client_negotiation.cc:769] Sending connection context
0809 23:22:20.177767 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 23:22:20.177933 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":88,"threads_started":1}
I20260809 23:22:20.178893 19278 heartbeater.cc:347] Connected to a master server at 127.1.235.190:38991
I20260809 23:22:20.178994 19278 heartbeater.cc:464] Registering TS with master...
I20260809 23:22:20.179186 19278 heartbeater.cc:511] Master 127.1.235.190:38991 requested a full tablet report, sending...
I20260809 23:22:20.179642 19064 ts_manager.cc:194] Registered new tserver with Master: faa3bfc9fb31464e844af7555da8f0d8 (127.1.235.129:44037)
I20260809 23:22:20.180213 19064 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:49343
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:22:20.200585 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:38991
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:22:20.280344 19284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:20.280527 19284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:20.280550 19284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:20.281528 19284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:20.281559 19284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:20.281582 19284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:22:20.282855 19284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:38991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:20.283020 19284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:20.283180 19284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:20.287770 19292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:20.287781 19291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:20.287842 19284 server_base.cc:1034] running on GCE node
W20260809 23:22:20.287798 19294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:20.288229 19284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:20.288492 19284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:20.289628 19284 hybrid_clock.cc:648] HybridClock initialized: now 1786317740289613 us; error 32 us; skew 500 ppm
Aug 09 23:22:20 dist-test-slave-6nmv krb5kdc[19015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317740, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:20.291915 19284 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:22:20.292343 19284 webserver.cc:460] Webserver started at http://127.1.235.130:46719/ using document root <none> and password file <none>
I20260809 23:22:20.292560 19284 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:20.292624 19284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:20.292768 19284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:22:20.293691 19284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65"
format_stamp: "Formatted at 2026-08-09 23:22:20 on dist-test-slave-6nmv"
server_key: "b3a9105bc1a0f22f46e420fa79a7f591"
server_key_iv: "e183e165b4581e1d73c00d735b2273ce"
server_key_version: "encryptionkey@0"
I20260809 23:22:20.294029 19284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65"
format_stamp: "Formatted at 2026-08-09 23:22:20 on dist-test-slave-6nmv"
server_key: "b3a9105bc1a0f22f46e420fa79a7f591"
server_key_iv: "e183e165b4581e1d73c00d735b2273ce"
server_key_version: "encryptionkey@0"
I20260809 23:22:20.295161 19284 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:22:20.295826 19302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:20.295984 19284 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:22:20.296070 19284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65"
format_stamp: "Formatted at 2026-08-09 23:22:20 on dist-test-slave-6nmv"
server_key: "b3a9105bc1a0f22f46e420fa79a7f591"
server_key_iv: "e183e165b4581e1d73c00d735b2273ce"
server_key_version: "encryptionkey@0"
I20260809 23:22:20.296145 19284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:20.336094 19284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:20.337839 19284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:20.338028 19284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:20.338274 19284 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:22:20.338538 19284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:22:20.338565 19284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:20.338584 19284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:22:20.338594 19284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:20.343719 19284 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:43021
I20260809 23:22:20.343765 19429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:43021 every 8 connection(s)
I20260809 23:22:20.344012 19284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:22:20.345515 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 19284
I20260809 23:22:20.345628 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:22:20.345884 1966 external_mini_cluster.cc:1428] Setting key 99833a71eb8ad8056cce0ad0538ddfbb
Aug 09 23:22:20 dist-test-slave-6nmv krb5kdc[19015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317740, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:22:20.353801 19131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.344625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:49921 (local address 127.1.235.190:38991)
0809 23:22:20.344684 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:20.344686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:20.344845 (+ 159us) server_negotiation.cc:407] Connection header received
0809 23:22:20.345267 (+ 422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:20.345268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:20.345277 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:20.345327 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:20.346506 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.347055 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.348064 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.348273 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.348361 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.350832 (+ 2471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:20.350833 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:20.350834 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:20.350842 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:20.352247 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:20.352753 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:20.352753 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:20.352754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:20.352845 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:20.353130 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:20.353130 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:20.353130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:20.353233 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:20.353284 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:20.353643 (+ 359us) server_negotiation.cc:299] Negotiation successful
0809 23:22:20.353730 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 23:22:20.354063 19433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.344587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:49921)
0809 23:22:20.344735 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:20.344770 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:20.345193 (+ 423us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:20.345422 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:20.345426 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:20.346147 (+ 721us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:22:20.346408 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:20.346413 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.347139 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.347140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:20.347974 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:20.347976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.348372 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.348373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:20.348520 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.349016 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:22:20.349024 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:22:20.350706 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:22:20.352335 (+ 1629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:20.352343 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:20.352345 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:20.352674 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:20.352924 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:20.352925 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:20.352926 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:20.353062 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:20.353301 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:22:20.353307 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:22:20.353480 (+ 173us) client_negotiation.cc:769] Sending connection context
0809 23:22:20.353646 (+ 166us) client_negotiation.cc:240] Negotiation successful
0809 23:22:20.353836 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":87,"threads_started":1}
I20260809 23:22:20.354554 19431 heartbeater.cc:347] Connected to a master server at 127.1.235.190:38991
I20260809 23:22:20.354658 19431 heartbeater.cc:464] Registering TS with master...
I20260809 23:22:20.354872 19431 heartbeater.cc:511] Master 127.1.235.190:38991 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
I20260809 23:22:20.355232 19064 ts_manager.cc:194] Registered new tserver with Master: a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021)
I20260809 23:22:20.355623 19064 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:49921
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:22:20.372349 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:38991
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:22:20.450583 19437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:20.450804 19437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:20.450843 19437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:20.452014 19437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:20.452080 19437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:20.452127 19437 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:22:20.453564 19437 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:38991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:20.453796 19437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:20.454078 19437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:20.458961 19443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:20.459033 19442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:20.458983 19446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:20.459188 19437 server_base.cc:1034] running on GCE node
I20260809 23:22:20.459426 19437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:20.459661 19437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:20.460793 19437 hybrid_clock.cc:648] HybridClock initialized: now 1786317740460765 us; error 43 us; skew 500 ppm
Aug 09 23:22:20 dist-test-slave-6nmv krb5kdc[19015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317740, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:20.463178 19437 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:22:20.463562 19437 webserver.cc:460] Webserver started at http://127.1.235.131:33821/ using document root <none> and password file <none>
I20260809 23:22:20.463764 19437 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:20.463804 19437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:20.463945 19437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:22:20.464890 19437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "120871e2438446ba95aa65546b1e80cc"
format_stamp: "Formatted at 2026-08-09 23:22:20 on dist-test-slave-6nmv"
server_key: "d76dd2abcf3e7a5991368997f321b797"
server_key_iv: "2d9e6e7fca071a54568ff73427aa2ac1"
server_key_version: "encryptionkey@0"
I20260809 23:22:20.465225 19437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "120871e2438446ba95aa65546b1e80cc"
format_stamp: "Formatted at 2026-08-09 23:22:20 on dist-test-slave-6nmv"
server_key: "d76dd2abcf3e7a5991368997f321b797"
server_key_iv: "2d9e6e7fca071a54568ff73427aa2ac1"
server_key_version: "encryptionkey@0"
I20260809 23:22:20.466507 19437 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:22:20.467267 19455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:20.467427 19437 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:22:20.467525 19437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "120871e2438446ba95aa65546b1e80cc"
format_stamp: "Formatted at 2026-08-09 23:22:20 on dist-test-slave-6nmv"
server_key: "d76dd2abcf3e7a5991368997f321b797"
server_key_iv: "2d9e6e7fca071a54568ff73427aa2ac1"
server_key_version: "encryptionkey@0"
I20260809 23:22:20.467604 19437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:20.491459 19437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:20.493733 19437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:20.493942 19437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:20.494170 19437 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:22:20.494441 19437 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:22:20.494488 19437 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:20.494525 19437 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:22:20.494549 19437 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:20.500475 19437 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:41971
I20260809 23:22:20.500550 19578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:41971 every 8 connection(s)
I20260809 23:22:20.500882 19437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
Aug 09 23:22:20 dist-test-slave-6nmv krb5kdc[19015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317740, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:22:20.507375 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 19437
I20260809 23:22:20.507486 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:22:20.507736 1966 external_mini_cluster.cc:1428] Setting key fd47f881e5145073bb1ca3bdd90b9dbd
I20260809 23:22:20.509932 19131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.501625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:58401 (local address 127.1.235.190:38991)
0809 23:22:20.501690 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:20.501693 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:20.501904 (+ 211us) server_negotiation.cc:407] Connection header received
0809 23:22:20.502402 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:20.502403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:20.502413 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:20.502463 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:20.503334 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.503806 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.504710 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.504882 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.504930 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.506940 (+ 2010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:20.506941 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:20.506942 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:20.506950 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:20.508806 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:20.509161 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:20.509161 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:20.509162 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:20.509214 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:20.509414 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:20.509415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:20.509415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:20.509515 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:20.509563 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:20.509751 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 23:22:20.509850 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 23:22:20.510094 19581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.501606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:58401)
0809 23:22:20.501762 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:20.501797 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:20.502319 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:20.502515 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:20.502518 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:20.503055 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:22:20.503262 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:20.503267 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.503882 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.503882 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:20.504640 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:20.504642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.504950 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.504951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:20.505055 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.505465 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:22:20.505473 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:22:20.506849 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:22:20.508876 (+ 2027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:20.508881 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:20.508883 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:20.509101 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:20.509264 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:20.509265 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:20.509265 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:20.509341 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:20.509554 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:22:20.509556 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:22:20.509653 (+ 97us) client_negotiation.cc:769] Sending connection context
0809 23:22:20.509726 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 23:22:20.509898 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":81,"threads_started":1}
I20260809 23:22:20.510586 19579 heartbeater.cc:347] Connected to a master server at 127.1.235.190:38991
I20260809 23:22:20.510679 19579 heartbeater.cc:464] Registering TS with master...
I20260809 23:22:20.510854 19579 heartbeater.cc:511] Master 127.1.235.190:38991 requested a full tablet report, sending...
I20260809 23:22:20.511200 19064 ts_manager.cc:194] Registered new tserver with Master: 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971)
I20260809 23:22:20.511544 19064 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:58401
I20260809 23:22:20.519497 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:22:20.526010 19131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.520768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58014 (local address 127.1.235.190:38991)
0809 23:22:20.520827 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:20.520829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:20.520885 (+ 56us) server_negotiation.cc:407] Connection header received
0809 23:22:20.520930 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:20.520930 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:20.520947 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:20.520993 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:20.521472 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.521996 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.522663 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.522838 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.522886 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.523985 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:20.523986 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:20.523986 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:20.523991 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:20.525049 (+ 1058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:20.525349 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:20.525350 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:20.525350 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:20.525395 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:20.525560 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:20.525561 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:20.525561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:20.525681 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:20.525751 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:20.525884 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 23:22:20.525953 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 23:22:20.527386 19064 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58014:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:22:20.528924 19064 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:22:20.535274 19591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.531315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:44037 (local address 127.0.0.1:33450)
0809 23:22:20.531450 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:20.531501 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:20.531575 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:20.532003 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:20.532006 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:20.532008 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:20.532073 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:20.532075 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.533025 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.533026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:20.534120 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:20.534123 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.534973 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.534974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:20.535062 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.535075 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 23:22:20.535160 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 23:22:20.535209 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":43,"threads_started":1}
I20260809 23:22:20.535298 19595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.531601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33450 (local address 127.1.235.129:44037)
0809 23:22:20.531780 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:20.531784 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:20.531796 (+ 12us) server_negotiation.cc:407] Connection header received
0809 23:22:20.531860 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:20.531862 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:20.531878 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:20.532153 (+ 275us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:20.532232 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.532919 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.534188 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.534871 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.534953 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.535011 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:20.535176 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 23:22:20.535221 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":96,"threads_started":1}
I20260809 23:22:20.535686 19593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.531334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:41971 (local address 127.0.0.1:40752)
0809 23:22:20.531941 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:20.531950 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:20.531993 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:20.532231 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:20.532232 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:20.532234 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:20.532269 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:20.532271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.533509 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.533510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:20.534501 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:20.534502 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.535418 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.535419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:20.535485 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.535490 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 23:22:20.535543 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 23:22:20.535577 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"mutex_wait_us":38,"thread_start_us":87,"threads_started":1}
I20260809 23:22:20.535686 19592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.531315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:43021 (local address 127.0.0.1:42726)
0809 23:22:20.531802 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:20.531813 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:20.531864 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:20.532247 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:20.532248 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:20.532250 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:20.532301 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:20.532304 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.533516 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.533517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:20.534562 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:20.534565 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.535418 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.535419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:20.535482 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.535486 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:22:20.535544 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 23:22:20.535577 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"mutex_wait_us":4,"thread_start_us":69,"threads_started":1}
I20260809 23:22:20.535938 19594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.531583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40752 (local address 127.1.235.131:41971)
0809 23:22:20.531744 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:20.531749 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:20.532045 (+ 296us) server_negotiation.cc:407] Connection header received
0809 23:22:20.532086 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:20.532088 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:20.532104 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:20.532167 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:20.532331 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.533385 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.534581 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.535255 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.535329 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.535382 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:20.535803 (+ 421us) server_negotiation.cc:299] Negotiation successful
0809 23:22:20.535845 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":98,"threads_started":1}
I20260809 23:22:20.536396 19203 tablet_service.cc:1467] Processing CreateTablet for tablet 05d94b77617a444e8ab2ac10b61dd390 (DEFAULT_TABLE table=test-table [id=34fde6e464474c32a0985b85d73df61e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:22:20.536523 19505 tablet_service.cc:1467] Processing CreateTablet for tablet 05d94b77617a444e8ab2ac10b61dd390 (DEFAULT_TABLE table=test-table [id=34fde6e464474c32a0985b85d73df61e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:22:20.536773 19203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05d94b77617a444e8ab2ac10b61dd390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:22:20.536808 19505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05d94b77617a444e8ab2ac10b61dd390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:22:20.540150 19597 tablet_bootstrap.cc:492] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc: Bootstrap starting.
I20260809 23:22:20.540227 19596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.531784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42726 (local address 127.1.235.130:43021)
0809 23:22:20.532021 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:20.532024 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:20.532034 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:22:20.532073 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:20.532075 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:20.532091 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:20.532169 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:20.532381 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.533414 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.534633 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.535283 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.535339 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.535382 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:20.535575 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 23:22:20.540137 (+ 4562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":103,"threads_started":1}
I20260809 23:22:20.540828 19597 tablet_bootstrap.cc:654] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc: Neither blocks nor log segments found. Creating new log.
I20260809 23:22:20.541011 19357 tablet_service.cc:1467] Processing CreateTablet for tablet 05d94b77617a444e8ab2ac10b61dd390 (DEFAULT_TABLE table=test-table [id=34fde6e464474c32a0985b85d73df61e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:22:20.541307 19357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05d94b77617a444e8ab2ac10b61dd390. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:22:20.541322 19597 log.cc:824] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:20.541702 19598 tablet_bootstrap.cc:492] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8: Bootstrap starting.
I20260809 23:22:20.542101 19597 tablet_bootstrap.cc:492] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc: No bootstrap required, opened a new log
I20260809 23:22:20.542156 19597 ts_tablet_manager.cc:1397] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:22:20.543677 19597 raft_consensus.cc:348] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } } peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } }
I20260809 23:22:20.543808 19597 raft_consensus.cc:374] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:22:20.543829 19597 raft_consensus.cc:729] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 120871e2438446ba95aa65546b1e80cc, State: Initialized, Role: FOLLOWER
I20260809 23:22:20.543946 19597 consensus_queue.cc:260] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } } peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } }
I20260809 23:22:20.544147 19600 tablet_bootstrap.cc:492] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65: Bootstrap starting.
I20260809 23:22:20.544268 19597 ts_tablet_manager.cc:1428] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 23:22:20.544399 19579 heartbeater.cc:503] Master 127.1.235.190:38991 was elected leader, sending a full tablet report...
I20260809 23:22:20.544818 19600 tablet_bootstrap.cc:654] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65: Neither blocks nor log segments found. Creating new log.
I20260809 23:22:20.544968 19598 tablet_bootstrap.cc:654] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8: Neither blocks nor log segments found. Creating new log.
I20260809 23:22:20.545347 19600 log.cc:824] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:20.545526 19598 log.cc:824] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:20.546169 19600 tablet_bootstrap.cc:492] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65: No bootstrap required, opened a new log
I20260809 23:22:20.546252 19600 ts_tablet_manager.cc:1397] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:22:20.546324 19598 tablet_bootstrap.cc:492] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8: No bootstrap required, opened a new log
I20260809 23:22:20.546386 19598 ts_tablet_manager.cc:1397] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260809 23:22:20.547818 19600 raft_consensus.cc:348] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } } peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } }
I20260809 23:22:20.547947 19600 raft_consensus.cc:374] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:22:20.547969 19600 raft_consensus.cc:729] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a73ef7e62edf4afa9fd9dd2ac2e62c65, State: Initialized, Role: FOLLOWER
I20260809 23:22:20.548076 19600 consensus_queue.cc:260] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } } peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } }
I20260809 23:22:20.548010 19598 raft_consensus.cc:348] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } } peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } }
I20260809 23:22:20.548192 19598 raft_consensus.cc:374] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:22:20.548237 19598 raft_consensus.cc:729] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faa3bfc9fb31464e844af7555da8f0d8, State: Initialized, Role: FOLLOWER
I20260809 23:22:20.548344 19600 ts_tablet_manager.cc:1428] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:22:20.548377 19431 heartbeater.cc:503] Master 127.1.235.190:38991 was elected leader, sending a full tablet report...
I20260809 23:22:20.548380 19598 consensus_queue.cc:260] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } } peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } }
I20260809 23:22:20.548683 19278 heartbeater.cc:503] Master 127.1.235.190:38991 was elected leader, sending a full tablet report...
I20260809 23:22:20.548729 19598 ts_tablet_manager.cc:1428] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260809 23:22:20.594573 19432 tablet.cc:2369] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 23:22:20.669926 19279 tablet.cc:2369] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 23:22:20.751485 19580 tablet.cc:2369] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:22:20.831452 19608 raft_consensus.cc:482] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:22:20.831575 19608 raft_consensus.cc:504] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } } peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } }
I20260809 23:22:20.832006 19608 leader_election.cc:288] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021), 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971)
I20260809 23:22:20.836102 19594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.832330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:41119 (local address 127.1.235.131:41971)
0809 23:22:20.832377 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:20.832380 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:20.832480 (+ 100us) server_negotiation.cc:407] Connection header received
0809 23:22:20.832521 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:20.832522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:20.832531 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:20.832600 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:20.832814 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.833542 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.835177 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.835727 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.835806 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.835814 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:20.835989 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 23:22:20.836030 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 23:22:20.836102 19596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.832330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:60343 (local address 127.1.235.130:43021)
0809 23:22:20.832377 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:20.832380 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:20.832481 (+ 101us) server_negotiation.cc:407] Connection header received
0809 23:22:20.832520 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:20.832521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:20.832531 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:20.832600 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:20.832815 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.833537 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.835177 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.835726 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.835806 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.835814 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:20.835998 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 23:22:20.836036 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 23:22:20.836115 19609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.832237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:43021 (local address 127.1.235.129:60343)
0809 23:22:20.832392 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:20.832401 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:20.832472 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:20.832613 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:20.832614 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:20.832618 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:20.832721 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:20.832723 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.833624 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.833624 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:20.835074 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:20.835077 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.835816 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.835817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:20.835897 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.835905 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 23:22:20.835962 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 23:22:20.836006 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":123,"spinlock_wait_cycles":12928,"thread_start_us":87,"threads_started":1}
I20260809 23:22:20.836119 19610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.832236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:41971 (local address 127.1.235.129:41119)
0809 23:22:20.832389 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:20.832401 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:20.832469 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:20.832613 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:20.832614 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:20.832616 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:20.832728 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:20.832729 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.833623 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.833624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:20.835074 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:20.835077 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.835814 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.835816 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:20.835897 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.835903 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 23:22:20.835973 (+ 70us) client_negotiation.cc:240] Negotiation successful
0809 23:22:20.836006 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":84,"thread_start_us":87,"threads_started":1}
I20260809 23:22:20.836500 19379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05d94b77617a444e8ab2ac10b61dd390" candidate_uuid: "faa3bfc9fb31464e844af7555da8f0d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" is_pre_election: true
I20260809 23:22:20.836673 19379 raft_consensus.cc:2454] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate faa3bfc9fb31464e844af7555da8f0d8 in term 0.
I20260809 23:22:20.836696 19528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05d94b77617a444e8ab2ac10b61dd390" candidate_uuid: "faa3bfc9fb31464e844af7555da8f0d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "120871e2438446ba95aa65546b1e80cc" is_pre_election: true
I20260809 23:22:20.836869 19528 raft_consensus.cc:2454] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate faa3bfc9fb31464e844af7555da8f0d8 in term 0.
I20260809 23:22:20.836943 19156 leader_election.cc:302] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a73ef7e62edf4afa9fd9dd2ac2e62c65, faa3bfc9fb31464e844af7555da8f0d8; no voters:
I20260809 23:22:20.837070 19608 raft_consensus.cc:2781] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:22:20.837123 19608 raft_consensus.cc:482] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:22:20.837174 19608 raft_consensus.cc:3037] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:22:20.837950 19608 raft_consensus.cc:504] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } } peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } }
I20260809 23:22:20.838104 19608 leader_election.cc:288] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 1 election: Requested vote from peers a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021), 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971)
I20260809 23:22:20.838274 19528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05d94b77617a444e8ab2ac10b61dd390" candidate_uuid: "faa3bfc9fb31464e844af7555da8f0d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "120871e2438446ba95aa65546b1e80cc"
I20260809 23:22:20.838338 19528 raft_consensus.cc:3037] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:22:20.839020 19528 raft_consensus.cc:2454] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa3bfc9fb31464e844af7555da8f0d8 in term 1.
I20260809 23:22:20.839111 19379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05d94b77617a444e8ab2ac10b61dd390" candidate_uuid: "faa3bfc9fb31464e844af7555da8f0d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65"
I20260809 23:22:20.839166 19379 raft_consensus.cc:3037] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:22:20.839321 19153 leader_election.cc:302] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 120871e2438446ba95aa65546b1e80cc, faa3bfc9fb31464e844af7555da8f0d8; no voters:
I20260809 23:22:20.839435 19608 raft_consensus.cc:2781] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:22:20.839630 19608 raft_consensus.cc:686] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 LEADER]: Becoming Leader. State: Replica: faa3bfc9fb31464e844af7555da8f0d8, State: Running, Role: LEADER
I20260809 23:22:20.839736 19608 consensus_queue.cc:237] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } } peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } }
I20260809 23:22:20.840082 19379 raft_consensus.cc:2454] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa3bfc9fb31464e844af7555da8f0d8 in term 1.
I20260809 23:22:20.840562 19064 catalog_manager.cc:5495] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to faa3bfc9fb31464e844af7555da8f0d8 (127.1.235.129). New cstate: current_term: 1 leader_uuid: "faa3bfc9fb31464e844af7555da8f0d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } health_report { overall_health: UNKNOWN } } }
I20260809 23:22:20.885774 19595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.883422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33464 (local address 127.1.235.129:44037)
0809 23:22:20.883498 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:20.883500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:20.883509 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:22:20.883551 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:20.883552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:20.883567 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:20.883640 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:22:20.883775 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.884207 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.884933 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:20.885195 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:20.885266 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:20.885442 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:22:20.885541 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:22:20.885645 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:20.885663 (+ 18us) server_negotiation.cc:299] Negotiation successful
0809 23:22:20.885680 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 23:22:20.887668 19528 raft_consensus.cc:1261] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc [term 1 FOLLOWER]: Refusing update from remote peer faa3bfc9fb31464e844af7555da8f0d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:22:20.887669 19379 raft_consensus.cc:1261] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 1 FOLLOWER]: Refusing update from remote peer faa3bfc9fb31464e844af7555da8f0d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:22:20.888029 19611 consensus_queue.cc:1035] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:22:20.888159 19608 consensus_queue.cc:1035] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:22:20.891098 19616 mvcc.cc:205] Tried to move back new op lower bound from 7316757466672947200 to 7316757466480234496. Current Snapshot: MvccSnapshot[applied={T|T < 7316757466672947200}]
I20260809 23:22:20.892486 19063 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58014:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:22:20.892578 19063 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58014:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:22:20.893260 19063 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: Sending DeleteTablet for 3 replicas of tablet 05d94b77617a444e8ab2ac10b61dd390
I20260809 23:22:20.893524 19203 tablet_service.cc:1514] Processing DeleteTablet for tablet 05d94b77617a444e8ab2ac10b61dd390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:22:20 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:33450
I20260809 23:22:20.893553 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 19135
I20260809 23:22:20.893613 19505 tablet_service.cc:1514] Processing DeleteTablet for tablet 05d94b77617a444e8ab2ac10b61dd390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:22:20 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:40752
I20260809 23:22:20.895931 19625 tablet_replica.cc:330] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc: stopping tablet replica
I20260809 23:22:20.896040 19625 raft_consensus.cc:2229] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:22:20.896129 19625 raft_consensus.cc:2258] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:22:20.896119 19357 tablet_service.cc:1514] Processing DeleteTablet for tablet 05d94b77617a444e8ab2ac10b61dd390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:22:20 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:42726
I20260809 23:22:20.896394 19627 tablet_replica.cc:330] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65: stopping tablet replica
I20260809 23:22:20.896507 19627 raft_consensus.cc:2229] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:22:20.896592 19627 raft_consensus.cc:2258] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:22:20.896673 19625 ts_tablet_manager.cc:1905] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:22:20.896930 19627 ts_tablet_manager.cc:1905] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:22:20.898383 19627 ts_tablet_manager.cc:1918] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:22:20.898460 19627 log.cc:1196] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/05d94b77617a444e8ab2ac10b61dd390
I20260809 23:22:20.898736 19627 ts_tablet_manager.cc:1939] T 05d94b77617a444e8ab2ac10b61dd390 P a73ef7e62edf4afa9fd9dd2ac2e62c65: Deleting consensus metadata
I20260809 23:22:20.898777 19625 ts_tablet_manager.cc:1918] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:22:20.898890 19625 log.cc:1196] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/05d94b77617a444e8ab2ac10b61dd390
I20260809 23:22:20.899185 19625 ts_tablet_manager.cc:1939] T 05d94b77617a444e8ab2ac10b61dd390 P 120871e2438446ba95aa65546b1e80cc: Deleting consensus metadata
I20260809 23:22:20.899168 19050 catalog_manager.cc:4841] TS a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021): tablet 05d94b77617a444e8ab2ac10b61dd390 (table test-table [id=34fde6e464474c32a0985b85d73df61e]) successfully deleted
I20260809 23:22:20.899592 19048 catalog_manager.cc:4841] TS 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971): tablet 05d94b77617a444e8ab2ac10b61dd390 (table test-table [id=34fde6e464474c32a0985b85d73df61e]) successfully deleted
W20260809 23:22:20.902221 19047 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.235.129:44037 (error 108)
I20260809 23:22:20.902516 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 19284
I20260809 23:22:20.902696 19592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:20.902570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:44037 (local address 127.0.0.1:33470)
0809 23:22:20.902632 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:20.902661 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.129:44037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 23:22:20.904325 19047 catalog_manager.cc:4584] TS faa3bfc9fb31464e844af7555da8f0d8 (127.1.235.129:44037): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 05d94b77617a444e8ab2ac10b61dd390: Network error: Client connection negotiation failed: client connection to 127.1.235.129:44037: connect: Connection refused (error 111)
I20260809 23:22:20.909524 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 19437
I20260809 23:22:20.913945 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 19031
I20260809 23:22:40.920531 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:38991
--webserver_interface=127.1.235.190
--webserver_port=36325
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:38991
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:22:41.002460 19629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:41.002660 19629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:41.002682 19629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:41.003794 19629 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 23:22:41.003831 19629 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 23:22:41.003844 19629 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 23:22:41.003855 19629 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:22:41.003927 19629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:41.003959 19629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:41.003981 19629 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:22:41.004006 19629 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:22:41.005489 19629 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:38991
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:38991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=36325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:41.005757 19629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:41.006002 19629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:41.015163 19636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:41.015172 19635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:41.015225 19629 server_base.cc:1034] running on GCE node
W20260809 23:22:41.015166 19638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:41.015641 19629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:41.015981 19629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:41.017145 19629 hybrid_clock.cc:648] HybridClock initialized: now 1786317761017136 us; error 48 us; skew 500 ppm
Aug 09 23:22:41 dist-test-slave-6nmv krb5kdc[19015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317761, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:41.026232 19629 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:22:41.026703 19629 webserver.cc:460] Webserver started at http://127.1.235.190:36325/ using document root <none> and password file <none>
I20260809 23:22:41.026974 19629 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:41.027069 19629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:41.028481 19629 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:22:41.029191 19645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:41.029369 19629 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:22:41.029474 19629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "e4d711b336ca4de6b485147f053fcf4e"
format_stamp: "Formatted at 2026-08-09 23:22:19 on dist-test-slave-6nmv"
server_key: "fd95cfb7c6c403a760038c792dce42c1"
server_key_iv: "493b7507417924de67a8dca61a1b2d35"
server_key_version: "encryptionkey@0"
I20260809 23:22:41.029961 19629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:41.048552 19629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:41.050608 19629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:41.050774 19629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:41.054980 19629 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:38991
I20260809 23:22:41.055015 19702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:38991 every 8 connection(s)
I20260809 23:22:41.055413 19629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:22:41.056830 19704 sys_catalog.cc:263] Verifying existing consensus state
I20260809 23:22:41.056888 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 19629
I20260809 23:22:41.057170 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:44037
--local_ip_for_outbound_sockets=127.1.235.129
--tserver_master_addrs=127.1.235.190:38991
--webserver_port=34251
--webserver_interface=127.1.235.129
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:22:41.057540 19704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: Bootstrap starting.
I20260809 23:22:41.066882 19704 log.cc:824] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:41.068699 19704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 23:22:41.069012 19704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: Bootstrap complete.
I20260809 23:22:41.071377 19704 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } }
I20260809 23:22:41.071604 19704 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4d711b336ca4de6b485147f053fcf4e, State: Initialized, Role: FOLLOWER
I20260809 23:22:41.071820 19704 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } }
I20260809 23:22:41.071880 19704 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:22:41.071944 19704 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:22:41.071995 19704 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 1 FOLLOWER]: Advancing to term 2
I20260809 23:22:41.073017 19704 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } }
I20260809 23:22:41.073123 19704 leader_election.cc:302] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4d711b336ca4de6b485147f053fcf4e; no voters:
I20260809 23:22:41.073328 19704 leader_election.cc:288] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 23:22:41.073385 19708 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 2 FOLLOWER]: Leader election won for term 2
I20260809 23:22:41.073555 19708 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 2 LEADER]: Becoming Leader. State: Replica: e4d711b336ca4de6b485147f053fcf4e, State: Running, Role: LEADER
I20260809 23:22:41.073639 19704 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:22:41.073704 19708 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } }
I20260809 23:22:41.074123 19710 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e4d711b336ca4de6b485147f053fcf4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } } }
I20260809 23:22:41.074203 19710 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [sys.catalog]: This master's current role is: LEADER
I20260809 23:22:41.074404 19709 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4d711b336ca4de6b485147f053fcf4e. Latest consensus state: current_term: 2 leader_uuid: "e4d711b336ca4de6b485147f053fcf4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } } }
I20260809 23:22:41.074499 19709 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [sys.catalog]: This master's current role is: LEADER
I20260809 23:22:41.074630 19718 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:22:41.075479 19718 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:22:41.075603 19718 catalog_manager.cc:1259] Loaded cluster ID: 7c6931eddbd04bb592a8a7bd8d8aa519
I20260809 23:22:41.075675 19718 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:22:41.076988 19718 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:22:41.077206 19718 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: Loaded TSK: 0
I20260809 23:22:41.091027 19718 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: Generated new TSK 1
I20260809 23:22:41.091122 19718 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 23:22:41.140285 19706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:41.140532 19706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:41.140569 19706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:41.141674 19706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:41.141770 19706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:41.141810 19706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:22:41.143214 19706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:44037
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=34251
--tserver_master_addrs=127.1.235.190:38991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:41.143473 19706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:41.143693 19706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:41.149555 19734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:41.149586 19735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:41.149586 19737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:41.149709 19706 server_base.cc:1034] running on GCE node
I20260809 23:22:41.150036 19706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:41.150305 19706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:41.151511 19706 hybrid_clock.cc:648] HybridClock initialized: now 1786317761151485 us; error 39 us; skew 500 ppm
Aug 09 23:22:41 dist-test-slave-6nmv krb5kdc[19015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317761, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:41.154536 19706 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:22:41.155052 19706 webserver.cc:460] Webserver started at http://127.1.235.129:34251/ using document root <none> and password file <none>
I20260809 23:22:41.155323 19706 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:41.155405 19706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:41.157039 19706 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260809 23:22:41.157936 19746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:41.158222 19706 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:22:41.158320 19706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "faa3bfc9fb31464e844af7555da8f0d8"
format_stamp: "Formatted at 2026-08-09 23:22:20 on dist-test-slave-6nmv"
server_key: "4e0579aed8d9e58e06a17411303eb6f1"
server_key_iv: "fa892f9cb2c875e3231d27287dedd826"
server_key_version: "encryptionkey@0"
I20260809 23:22:41.158731 19706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:41.171943 19706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:41.174396 19706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:41.174542 19706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:41.174834 19706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:22:41.175319 19754 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 23:22:41.176712 19706 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 23:22:41.176769 19706 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 23:22:41.176798 19706 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 23:22:41.177603 19706 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 23:22:41.177645 19706 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 23:22:41.177719 19754 tablet_bootstrap.cc:492] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8: Bootstrap starting.
I20260809 23:22:41.185603 19706 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:44037
I20260809 23:22:41.185662 19873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:44037 every 8 connection(s)
I20260809 23:22:41.186151 19706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:22:41.189023 19754 log.cc:824] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:41.191552 19754 tablet_bootstrap.cc:492] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 23:22:41.191949 19754 tablet_bootstrap.cc:492] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8: Bootstrap complete.
I20260809 23:22:41.193017 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 19706
I20260809 23:22:41.193231 19754 ts_tablet_manager.cc:1397] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.011s
I20260809 23:22:41.193311 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:43021
--local_ip_for_outbound_sockets=127.1.235.130
--tserver_master_addrs=127.1.235.190:38991
--webserver_port=46719
--webserver_interface=127.1.235.130
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:22:41.194542 19754 raft_consensus.cc:348] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } } peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } }
I20260809 23:22:41.194854 19754 raft_consensus.cc:729] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: faa3bfc9fb31464e844af7555da8f0d8, State: Initialized, Role: FOLLOWER
I20260809 23:22:41.195019 19754 consensus_queue.cc:260] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } } peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } }
I20260809 23:22:41.195286 19754 ts_tablet_manager.cc:1428] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
Aug 09 23:22:41 dist-test-slave-6nmv krb5kdc[19015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317761, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:22:41.201941 19878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.186885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:39943)
0809 23:22:41.189944 (+ 3059us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:41.189989 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:41.190624 (+ 635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:41.191093 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:41.191097 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:41.191442 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:22:41.191726 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:41.191732 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.193461 (+ 1729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.193462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:41.194738 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:41.194740 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.195621 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.195622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:41.195717 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.196266 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:22:41.196273 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:22:41.197899 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:22:41.200004 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:41.200011 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:41.200013 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:41.200322 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:41.200643 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:41.200644 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:41.200644 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:41.200788 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:41.201307 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:22:41.201314 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:22:41.201461 (+ 147us) client_negotiation.cc:769] Sending connection context
0809 23:22:41.201571 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 23:22:41.201729 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3006,"thread_start_us":91,"threads_started":1}
I20260809 23:22:41.202104 19879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.187025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:39943 (local address 127.1.235.190:38991)
0809 23:22:41.187205 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:41.187213 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:41.190120 (+ 2907us) server_negotiation.cc:407] Connection header received
0809 23:22:41.190836 (+ 716us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:41.190843 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:41.190899 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:41.191039 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:41.191858 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.193347 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.194845 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.195450 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.195527 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.198012 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:41.198016 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:41.198016 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:41.198028 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:41.199896 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:41.200432 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:41.200436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:41.200436 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:41.200561 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:41.200890 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:41.200891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:41.200892 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:41.201211 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:41.201304 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:41.201671 (+ 367us) server_negotiation.cc:299] Negotiation successful
0809 23:22:41.201848 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":90,"threads_started":1}
I20260809 23:22:41.202996 19876 heartbeater.cc:347] Connected to a master server at 127.1.235.190:38991
I20260809 23:22:41.203106 19876 heartbeater.cc:464] Registering TS with master...
I20260809 23:22:41.203302 19876 heartbeater.cc:511] Master 127.1.235.190:38991 requested a full tablet report, sending...
I20260809 23:22:41.204098 19663 ts_manager.cc:194] Registered new tserver with Master: faa3bfc9fb31464e844af7555da8f0d8 (127.1.235.129:44037)
I20260809 23:22:41.205173 19663 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:39943
I20260809 23:22:41.206418 19876 heartbeater.cc:503] Master 127.1.235.190:38991 was elected leader, sending a full tablet report...
I20260809 23:22:41.210992 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.205703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48254 (local address 127.1.235.129:44037)
0809 23:22:41.206647 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:41.206652 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:41.206918 (+ 266us) server_negotiation.cc:407] Connection header received
0809 23:22:41.207044 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:41.207047 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:41.207061 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:41.207137 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:41.207306 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.208249 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.209775 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.210598 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.210681 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.210770 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:41.210884 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 23:22:41.210924 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":909,"thread_start_us":73,"threads_started":1}
I20260809 23:22:41.210996 19883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.205572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:44037 (local address 127.0.0.1:48254)
0809 23:22:41.206729 (+ 1157us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:41.206780 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:41.206942 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:41.207157 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:41.207160 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:41.207162 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:41.207239 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:41.207240 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.208331 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.208332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:41.209676 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:41.209678 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.210692 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.210693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:41.210784 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.210797 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 23:22:41.210872 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 23:22:41.210921 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1119,"thread_start_us":89,"threads_started":1}
I20260809 23:22:41.211687 19799 tablet_service.cc:1514] Processing DeleteTablet for tablet 05d94b77617a444e8ab2ac10b61dd390 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:22:20 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:48254
I20260809 23:22:41.212234 19885 tablet_replica.cc:330] stopping tablet replica
I20260809 23:22:41.212330 19885 raft_consensus.cc:2229] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:22:41.212390 19885 raft_consensus.cc:2258] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:22:41.212736 19885 ts_tablet_manager.cc:1905] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:22:41.215178 19885 ts_tablet_manager.cc:1918] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:22:41.215252 19885 log.cc:1196] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal/wals/05d94b77617a444e8ab2ac10b61dd390
I20260809 23:22:41.215519 19885 ts_tablet_manager.cc:1939] T 05d94b77617a444e8ab2ac10b61dd390 P faa3bfc9fb31464e844af7555da8f0d8: Deleting consensus metadata
I20260809 23:22:41.215986 19646 catalog_manager.cc:4841] TS faa3bfc9fb31464e844af7555da8f0d8 (127.1.235.129:44037): tablet 05d94b77617a444e8ab2ac10b61dd390 (table test-table [id=34fde6e464474c32a0985b85d73df61e]) successfully deleted
W20260809 23:22:41.278920 19881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:41.279098 19881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:41.279119 19881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:41.280254 19881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:41.280294 19881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:41.280320 19881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:22:41.281801 19881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:43021
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=46719
--tserver_master_addrs=127.1.235.190:38991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:41.282233 19881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:41.282469 19881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:41.287374 19893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:41.287352 19890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:41.287353 19891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:41.287497 19881 server_base.cc:1034] running on GCE node
I20260809 23:22:41.287776 19881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:41.288055 19881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:41.289251 19881 hybrid_clock.cc:648] HybridClock initialized: now 1786317761289235 us; error 30 us; skew 500 ppm
Aug 09 23:22:41 dist-test-slave-6nmv krb5kdc[19015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317761, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:41.291682 19881 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:22:41.292095 19881 webserver.cc:460] Webserver started at http://127.1.235.130:46719/ using document root <none> and password file <none>
I20260809 23:22:41.292337 19881 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:41.292418 19881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:41.293728 19881 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:22:41.294364 19902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:41.294538 19881 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 23:22:41.294632 19881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65"
format_stamp: "Formatted at 2026-08-09 23:22:20 on dist-test-slave-6nmv"
server_key: "b3a9105bc1a0f22f46e420fa79a7f591"
server_key_iv: "e183e165b4581e1d73c00d735b2273ce"
server_key_version: "encryptionkey@0"
I20260809 23:22:41.294970 19881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:41.313549 19881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:41.316035 19881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:41.316197 19881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:41.316430 19881 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:22:41.316731 19881 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:22:41.316784 19881 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:41.316824 19881 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:22:41.316856 19881 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:41.322964 19881 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:43021
I20260809 23:22:41.323011 20024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:43021 every 8 connection(s)
I20260809 23:22:41.323311 19881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
Aug 09 23:22:41 dist-test-slave-6nmv krb5kdc[19015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317761, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:22:41.331506 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 19881
I20260809 23:22:41.331830 19879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.324029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:46869 (local address 127.1.235.190:38991)
0809 23:22:41.324075 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:41.324077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:41.324286 (+ 209us) server_negotiation.cc:407] Connection header received
0809 23:22:41.324690 (+ 404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:41.324691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:41.324704 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:41.324763 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:41.325561 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.326118 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.327062 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.327250 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.327306 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.329121 (+ 1815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:41.329122 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:41.329122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:41.329129 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:41.330544 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:41.330907 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:41.330908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:41.330908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:41.330964 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:41.331168 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:41.331168 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:41.331169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:41.331275 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:41.331332 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:41.331671 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 23:22:41.331762 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:22:41.331864 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:41971
--local_ip_for_outbound_sockets=127.1.235.131
--tserver_master_addrs=127.1.235.190:38991
--webserver_port=33821
--webserver_interface=127.1.235.131
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:22:41.332036 20027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.324026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:46869)
0809 23:22:41.324174 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:41.324204 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:41.324609 (+ 405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:41.324810 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:41.324813 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:41.325304 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:22:41.325471 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:41.325476 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.326202 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.326202 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:41.326987 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:41.326989 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.327320 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.327321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:41.327410 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.327792 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:22:41.327799 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:22:41.329014 (+ 1215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:22:41.330618 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:41.330624 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:41.330626 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:41.330836 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:41.331019 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:41.331019 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:41.331019 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:41.331110 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:41.331338 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:22:41.331344 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:22:41.331492 (+ 148us) client_negotiation.cc:769] Sending connection context
0809 23:22:41.331616 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 23:22:41.331801 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":93,"threads_started":1}
I20260809 23:22:41.332633 20025 heartbeater.cc:347] Connected to a master server at 127.1.235.190:38991
I20260809 23:22:41.332732 20025 heartbeater.cc:464] Registering TS with master...
I20260809 23:22:41.332994 20025 heartbeater.cc:511] Master 127.1.235.190:38991 requested a full tablet report, sending...
I20260809 23:22:41.333457 19663 ts_manager.cc:194] Registered new tserver with Master: a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021)
I20260809 23:22:41.334000 19663 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:46869
W20260809 23:22:41.413195 20028 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:22:41.413395 20028 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:22:41.413420 20028 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:22:41.414526 20028 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:22:41.414572 20028 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:22:41.414599 20028 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:22:41.415941 20028 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:41971
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=33821
--tserver_master_addrs=127.1.235.190:38991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:22:41.416126 20028 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:22:41.416297 20028 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:22:41.421293 20033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:41.421509 20028 server_base.cc:1034] running on GCE node
W20260809 23:22:41.421376 20034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:22:41.421418 20036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:22:41.421895 20028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:22:41.422184 20028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:22:41.423336 20028 hybrid_clock.cc:648] HybridClock initialized: now 1786317761423334 us; error 33 us; skew 500 ppm
Aug 09 23:22:41 dist-test-slave-6nmv krb5kdc[19015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317761, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:22:41.425879 20028 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:22:41.426307 20028 webserver.cc:460] Webserver started at http://127.1.235.131:33821/ using document root <none> and password file <none>
I20260809 23:22:41.426551 20028 fs_manager.cc:359] Metadata directory not provided
I20260809 23:22:41.426638 20028 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:22:41.428112 20028 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:22:41.428730 20046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:41.428915 20028 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:22:41.429011 20028 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "120871e2438446ba95aa65546b1e80cc"
format_stamp: "Formatted at 2026-08-09 23:22:20 on dist-test-slave-6nmv"
server_key: "d76dd2abcf3e7a5991368997f321b797"
server_key_iv: "2d9e6e7fca071a54568ff73427aa2ac1"
server_key_version: "encryptionkey@0"
I20260809 23:22:41.429363 20028 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:22:41.442896 20028 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:22:41.444633 20028 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:22:41.444788 20028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:22:41.445010 20028 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:22:41.445314 20028 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:22:41.445369 20028 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:41.445408 20028 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:22:41.445436 20028 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:41.451445 20028 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:41971
I20260809 23:22:41.451545 20174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:41971 every 8 connection(s)
I20260809 23:22:41.451870 20028 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
Aug 09 23:22:41 dist-test-slave-6nmv krb5kdc[19015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317761, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:22:41.457868 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 20028
I20260809 23:22:41.460923 19879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.452562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:38775 (local address 127.1.235.190:38991)
0809 23:22:41.452654 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:41.452657 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:41.452876 (+ 219us) server_negotiation.cc:407] Connection header received
0809 23:22:41.453323 (+ 447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:41.453324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:41.453334 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:41.453382 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:41.454360 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.454835 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.455704 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.455877 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.455929 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.457934 (+ 2005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:41.457936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:41.457936 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:41.457946 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:41.459593 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:41.459989 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:41.459990 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:41.459991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:41.460056 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:41.460309 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:41.460310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:41.460310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:41.460443 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:41.460514 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:41.460741 (+ 227us) server_negotiation.cc:299] Negotiation successful
0809 23:22:41.460827 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 23:22:41.461017 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.452542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:38775)
0809 23:22:41.452732 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:41.452766 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:41.453249 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:41.453430 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:41.453433 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:41.454096 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:22:41.454278 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:41.454283 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.454911 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.454912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:41.455633 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:41.455636 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.455945 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.455946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:41.456039 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.456464 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:22:41.456471 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:22:41.457778 (+ 1307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:22:41.459669 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:41.459675 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:41.459678 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:41.459899 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:41.460134 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:22:41.460135 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:22:41.460135 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:22:41.460242 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:22:41.460509 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:22:41.460513 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:22:41.460618 (+ 105us) client_negotiation.cc:769] Sending connection context
0809 23:22:41.460697 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 23:22:41.460813 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":113,"threads_started":1}
I20260809 23:22:41.461489 20175 heartbeater.cc:347] Connected to a master server at 127.1.235.190:38991
I20260809 23:22:41.461578 20175 heartbeater.cc:464] Registering TS with master...
I20260809 23:22:41.461759 20175 heartbeater.cc:511] Master 127.1.235.190:38991 requested a full tablet report, sending...
I20260809 23:22:41.462188 19663 ts_manager.cc:194] Registered new tserver with Master: 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971)
I20260809 23:22:41.462592 19663 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:38775
I20260809 23:22:41.465207 20180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.458482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50944 (local address 127.1.235.190:38991)
0809 23:22:41.458612 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:41.458613 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:41.458621 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:22:41.458641 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:41.458641 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:41.458670 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:41.458720 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:41.459498 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.459979 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.460994 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.461316 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.461377 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.462814 (+ 1437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:41.462815 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:41.462815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:41.462823 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:41.464133 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:41.464441 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:41.464442 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:41.464443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:41.464500 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:41.464718 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:41.464719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:41.464719 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:41.464818 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:41.464999 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:41.465032 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 23:22:41.465117 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":89,"threads_started":1}
I20260809 23:22:41.465878 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:22:41.468382 20180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.466215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50948 (local address 127.1.235.190:38991)
0809 23:22:41.466272 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:41.466274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:41.466325 (+ 51us) server_negotiation.cc:407] Connection header received
0809 23:22:41.466400 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:41.466400 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:41.466432 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:41.466528 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:22:41.466619 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.467053 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.467718 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.467913 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.467980 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.468135 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:22:41.468175 (+ 40us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 23:22:41.468321 (+ 146us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50948: token expired
Metrics: {"server-negotiator.queue_time_us":36}
W20260809 23:22:41.468433 20180 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50948: token expired
W20260809 23:22:41.468695 19582 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.1.235.190:38991)
I20260809 23:22:41.474345 20180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.468940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50952 (local address 127.1.235.190:38991)
0809 23:22:41.468996 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:41.468998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:41.469006 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:22:41.469057 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:41.469058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:41.469066 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:41.469108 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:22:41.469590 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.470151 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.470812 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.470982 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.471048 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.472043 (+ 995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:22:41.472044 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:22:41.472045 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:22:41.472052 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:22:41.473136 (+ 1084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:41.473488 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:41.473490 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:41.473490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:41.473562 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:22:41.473766 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:22:41.473767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:22:41.473767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:22:41.473943 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:22:41.474056 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:41.474182 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 23:22:41.474254 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 23:22:41.475502 19663 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50952:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:22:41.476933 19663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:22:41.478821 19799 tablet_service.cc:1467] Processing CreateTablet for tablet fa02d323f0c447b898250e4ff076f351 (DEFAULT_TABLE table=test-table [id=9b31f9d505514f8ba9cb76ab1d6a8467]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:22:41.479036 19799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa02d323f0c447b898250e4ff076f351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:22:41.480434 19754 tablet_bootstrap.cc:492] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8: Bootstrap starting.
I20260809 23:22:41.480791 19754 tablet_bootstrap.cc:654] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8: Neither blocks nor log segments found. Creating new log.
I20260809 23:22:41.481977 19754 tablet_bootstrap.cc:492] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8: No bootstrap required, opened a new log
I20260809 23:22:41.482041 19754 ts_tablet_manager.cc:1397] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:22:41.482162 19754 raft_consensus.cc:348] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } } peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } }
I20260809 23:22:41.482231 19754 raft_consensus.cc:374] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:22:41.482281 19754 raft_consensus.cc:729] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faa3bfc9fb31464e844af7555da8f0d8, State: Initialized, Role: FOLLOWER
I20260809 23:22:41.482332 19754 consensus_queue.cc:260] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } } peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } }
I20260809 23:22:41.482422 19754 ts_tablet_manager.cc:1428] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260809 23:22:41.483129 20182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.478589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:41971 (local address 127.0.0.1:38772)
0809 23:22:41.478755 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:41.478763 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:41.478798 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:41.479144 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:41.479145 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:41.479147 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:41.479193 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:41.479194 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.480192 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.480193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:41.481104 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:41.481107 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.482875 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.482876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:41.482948 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.482952 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:22:41.483019 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 23:22:41.483059 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":121,"threads_started":1}
I20260809 23:22:41.483143 20184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.478823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38772 (local address 127.1.235.131:41971)
0809 23:22:41.478987 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:41.478991 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:41.479001 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:22:41.479042 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:41.479043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:41.479054 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:41.479147 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:41.479270 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.480114 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.481188 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.482765 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.482853 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.482929 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:41.483033 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 23:22:41.483068 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":101,"threads_started":1}
I20260809 23:22:41.484179 19883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.478550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:43021 (local address 127.0.0.1:49786)
0809 23:22:41.478591 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:41.478600 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:41.478631 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:41.480700 (+ 2069us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:41.480701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:41.480702 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:41.480731 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:41.480732 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.481914 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.481914 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:41.483083 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:41.483086 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.483999 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.483999 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:41.484044 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.484047 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:22:41.484106 (+ 59us) client_negotiation.cc:240] Negotiation successful
0809 23:22:41.484137 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260809 23:22:41.484095 20100 tablet_service.cc:1467] Processing CreateTablet for tablet fa02d323f0c447b898250e4ff076f351 (DEFAULT_TABLE table=test-table [id=9b31f9d505514f8ba9cb76ab1d6a8467]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:22:41.484237 20183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.478650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49786 (local address 127.1.235.130:43021)
0809 23:22:41.480538 (+ 1888us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:41.480542 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:41.480552 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:22:41.480592 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:41.480597 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:41.480613 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:41.480696 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:41.480779 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.481767 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.483168 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.483911 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.483988 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.484038 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:41.484121 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 23:22:41.484162 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1850,"thread_start_us":75,"threads_started":1}
I20260809 23:22:41.484433 20100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa02d323f0c447b898250e4ff076f351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:22:41.484818 19957 tablet_service.cc:1467] Processing CreateTablet for tablet fa02d323f0c447b898250e4ff076f351 (DEFAULT_TABLE table=test-table [id=9b31f9d505514f8ba9cb76ab1d6a8467]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:22:41.485065 19957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa02d323f0c447b898250e4ff076f351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:22:41.487293 20186 tablet_bootstrap.cc:492] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc: Bootstrap starting.
I20260809 23:22:41.487715 20187 tablet_bootstrap.cc:492] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65: Bootstrap starting.
I20260809 23:22:41.488031 20186 tablet_bootstrap.cc:654] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc: Neither blocks nor log segments found. Creating new log.
I20260809 23:22:41.488368 20187 tablet_bootstrap.cc:654] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65: Neither blocks nor log segments found. Creating new log.
I20260809 23:22:41.488601 20186 log.cc:824] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:41.488953 20187 log.cc:824] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65: Log is configured to *not* fsync() on all Append() calls
I20260809 23:22:41.489384 20186 tablet_bootstrap.cc:492] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc: No bootstrap required, opened a new log
I20260809 23:22:41.489490 20186 ts_tablet_manager.cc:1397] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:22:41.489703 20187 tablet_bootstrap.cc:492] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65: No bootstrap required, opened a new log
I20260809 23:22:41.489758 20187 ts_tablet_manager.cc:1397] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:22:41.491139 20186 raft_consensus.cc:348] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } } peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } }
I20260809 23:22:41.491297 20186 raft_consensus.cc:374] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:22:41.491340 20186 raft_consensus.cc:729] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 120871e2438446ba95aa65546b1e80cc, State: Initialized, Role: FOLLOWER
I20260809 23:22:41.491469 20186 consensus_queue.cc:260] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } } peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } }
I20260809 23:22:41.491397 20187 raft_consensus.cc:348] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } } peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } }
I20260809 23:22:41.491560 20187 raft_consensus.cc:374] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:22:41.491634 20187 raft_consensus.cc:729] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a73ef7e62edf4afa9fd9dd2ac2e62c65, State: Initialized, Role: FOLLOWER
I20260809 23:22:41.491799 20175 heartbeater.cc:503] Master 127.1.235.190:38991 was elected leader, sending a full tablet report...
I20260809 23:22:41.491771 20187 consensus_queue.cc:260] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } } peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } }
I20260809 23:22:41.492075 20186 ts_tablet_manager.cc:1428] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:22:41.492064 20025 heartbeater.cc:503] Master 127.1.235.190:38991 was elected leader, sending a full tablet report...
I20260809 23:22:41.492046 20187 ts_tablet_manager.cc:1428] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260809 23:22:41.523718 19882 raft_consensus.cc:482] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:22:41.523842 19882 raft_consensus.cc:504] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } } peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } }
I20260809 23:22:41.524212 19882 leader_election.cc:288] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021), 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971)
I20260809 23:22:41.527087 20183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.524514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:42785 (local address 127.1.235.130:43021)
0809 23:22:41.524582 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:41.524584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:41.524592 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:22:41.524617 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:41.524617 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:41.524630 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:41.524691 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:41.525114 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.525547 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.526427 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.526765 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.526842 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.526851 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:41.526980 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 23:22:41.527029 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 23:22:41.527091 19878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.524368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:43021 (local address 127.1.235.129:42785)
0809 23:22:41.524410 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:41.524421 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:41.524488 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:41.524700 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:41.524700 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:41.524702 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:41.525029 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:41.525031 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.525628 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.525629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:41.526344 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:41.526346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.526839 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.526840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:41.526911 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.526913 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:22:41.526974 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 23:22:41.527018 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22,"mutex_wait_us":2}
I20260809 23:22:41.527164 20184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.524517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:57153 (local address 127.1.235.131:41971)
0809 23:22:41.524578 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:41.524581 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:41.524702 (+ 121us) server_negotiation.cc:407] Connection header received
0809 23:22:41.524764 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:41.524765 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:41.524774 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:41.524844 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:22:41.525023 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.525480 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.526430 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.526765 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.526844 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.526854 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:41.527057 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 23:22:41.527099 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 23:22:41.527274 20192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.524418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:41971 (local address 127.1.235.129:57153)
0809 23:22:41.524613 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:41.524630 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 23:22:41.524708 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:22:41.524846 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:22:41.524846 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:22:41.524848 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:22:41.524925 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:41.524927 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.525560 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.525560 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:41.526343 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:22:41.526345 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.526862 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.526863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:22:41.526924 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.526927 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:22:41.527002 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 23:22:41.527099 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":4,"thread_start_us":144,"threads_started":1}
I20260809 23:22:41.527578 20122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa02d323f0c447b898250e4ff076f351" candidate_uuid: "faa3bfc9fb31464e844af7555da8f0d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "120871e2438446ba95aa65546b1e80cc" is_pre_election: true
I20260809 23:22:41.527611 19978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa02d323f0c447b898250e4ff076f351" candidate_uuid: "faa3bfc9fb31464e844af7555da8f0d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" is_pre_election: true
I20260809 23:22:41.527729 20122 raft_consensus.cc:2454] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate faa3bfc9fb31464e844af7555da8f0d8 in term 0.
I20260809 23:22:41.527753 19978 raft_consensus.cc:2454] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate faa3bfc9fb31464e844af7555da8f0d8 in term 0.
I20260809 23:22:41.527969 19748 leader_election.cc:302] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 120871e2438446ba95aa65546b1e80cc, faa3bfc9fb31464e844af7555da8f0d8; no voters:
I20260809 23:22:41.528115 19882 raft_consensus.cc:2781] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:22:41.528159 19882 raft_consensus.cc:482] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:22:41.528173 19882 raft_consensus.cc:3037] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:22:41.528801 19882 raft_consensus.cc:504] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } } peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } }
I20260809 23:22:41.528927 19882 leader_election.cc:288] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 1 election: Requested vote from peers a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021), 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971)
I20260809 23:22:41.529060 19978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa02d323f0c447b898250e4ff076f351" candidate_uuid: "faa3bfc9fb31464e844af7555da8f0d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65"
I20260809 23:22:41.529147 19978 raft_consensus.cc:3037] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:22:41.529217 20122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa02d323f0c447b898250e4ff076f351" candidate_uuid: "faa3bfc9fb31464e844af7555da8f0d8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "120871e2438446ba95aa65546b1e80cc"
I20260809 23:22:41.529312 20122 raft_consensus.cc:3037] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:22:41.530022 19978 raft_consensus.cc:2454] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa3bfc9fb31464e844af7555da8f0d8 in term 1.
I20260809 23:22:41.530189 19750 leader_election.cc:302] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a73ef7e62edf4afa9fd9dd2ac2e62c65, faa3bfc9fb31464e844af7555da8f0d8; no voters:
I20260809 23:22:41.530210 20122 raft_consensus.cc:2454] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa3bfc9fb31464e844af7555da8f0d8 in term 1.
I20260809 23:22:41.530295 19882 raft_consensus.cc:2781] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:22:41.530468 19882 raft_consensus.cc:686] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 LEADER]: Becoming Leader. State: Replica: faa3bfc9fb31464e844af7555da8f0d8, State: Running, Role: LEADER
I20260809 23:22:41.530556 19882 consensus_queue.cc:237] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } } peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } }
I20260809 23:22:41.531258 19663 catalog_manager.cc:5495] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 reported cstate change: term changed from 0 to 1, leader changed from <none> to faa3bfc9fb31464e844af7555da8f0d8 (127.1.235.129). New cstate: current_term: 1 leader_uuid: "faa3bfc9fb31464e844af7555da8f0d8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } health_report { overall_health: HEALTHY } } }
I20260809 23:22:41.542611 19884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.540686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48264 (local address 127.1.235.129:44037)
0809 23:22:41.540764 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0809 23:22:41.540766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:22:41.540774 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:22:41.540807 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:22:41.540807 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:22:41.540821 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:22:41.540875 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:22:41.540979 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.541378 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.542028 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:22:41.542192 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:22:41.542242 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:22:41.542350 (+ 108us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:22:41.542431 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:22:41.542485 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 23:22:41.542513 (+ 28us) server_negotiation.cc:299] Negotiation successful
0809 23:22:41.542528 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 23:22:41.543911 20122 raft_consensus.cc:1261] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc [term 1 FOLLOWER]: Refusing update from remote peer faa3bfc9fb31464e844af7555da8f0d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:22:41.544173 19978 raft_consensus.cc:1261] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 1 FOLLOWER]: Refusing update from remote peer faa3bfc9fb31464e844af7555da8f0d8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:22:41.544258 20193 consensus_queue.cc:1035] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:22:41.544414 19882 consensus_queue.cc:1035] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:22:41.547575 20198 mvcc.cc:205] Tried to move back new op lower bound from 7316757551281672192 to 7316757551229628416. Current Snapshot: MvccSnapshot[applied={T|T < 7316757551281672192}]
I20260809 23:22:41.549057 19663 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:22:41.549165 19663 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:22:41.549916 19663 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: Sending DeleteTablet for 3 replicas of tablet fa02d323f0c447b898250e4ff076f351
I20260809 23:22:41.550230 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 19706
I20260809 23:22:41.550235 19957 tablet_service.cc:1514] Processing DeleteTablet for tablet fa02d323f0c447b898250e4ff076f351 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:22:41 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:49786
I20260809 23:22:41.550271 20100 tablet_service.cc:1514] Processing DeleteTablet for tablet fa02d323f0c447b898250e4ff076f351 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:22:41 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:38772
I20260809 23:22:41.553923 20206 tablet_replica.cc:330] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65: stopping tablet replica
I20260809 23:22:41.554018 20206 raft_consensus.cc:2229] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:22:41.554111 20206 raft_consensus.cc:2258] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:22:41.554560 20206 ts_tablet_manager.cc:1905] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:22:41.556555 20206 ts_tablet_manager.cc:1918] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:22:41.556635 20206 log.cc:1196] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/fa02d323f0c447b898250e4ff076f351
I20260809 23:22:41.556910 20206 ts_tablet_manager.cc:1939] T fa02d323f0c447b898250e4ff076f351 P a73ef7e62edf4afa9fd9dd2ac2e62c65: Deleting consensus metadata
I20260809 23:22:41.557302 19649 catalog_manager.cc:4841] TS a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021): tablet fa02d323f0c447b898250e4ff076f351 (table test-table [id=9b31f9d505514f8ba9cb76ab1d6a8467]) successfully deleted
I20260809 23:22:41.557986 20207 tablet_replica.cc:330] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc: stopping tablet replica
I20260809 23:22:41.558095 20207 raft_consensus.cc:2229] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:22:41.558214 20207 raft_consensus.cc:2258] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:22:41.558640 20207 ts_tablet_manager.cc:1905] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:22:41.559839 20207 ts_tablet_manager.cc:1918] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:22:41.559898 20207 log.cc:1196] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/fa02d323f0c447b898250e4ff076f351
W20260809 23:22:41.560140 19646 connection.cc:535] client connection to 127.1.235.129:44037 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 23:22:41.560225 20207 ts_tablet_manager.cc:1939] T fa02d323f0c447b898250e4ff076f351 P 120871e2438446ba95aa65546b1e80cc: Deleting consensus metadata
W20260809 23:22:41.560256 19646 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 23:22:41.560670 19647 catalog_manager.cc:4841] TS 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971): tablet fa02d323f0c447b898250e4ff076f351 (table test-table [id=9b31f9d505514f8ba9cb76ab1d6a8467]) successfully deleted
I20260809 23:22:41.560760 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 19881
I20260809 23:22:41.560773 19883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:22:41.560639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:44037 (local address 127.0.0.1:48272)
0809 23:22:41.560677 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0809 23:22:41.560720 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.129:44037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260809 23:22:41.560880 19646 catalog_manager.cc:4584] TS faa3bfc9fb31464e844af7555da8f0d8 (127.1.235.129:44037): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fa02d323f0c447b898250e4ff076f351: Network error: Client connection negotiation failed: client connection to 127.1.235.129:44037: connect: Connection refused (error 111)
I20260809 23:22:41.567050 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 20028
I20260809 23:22:41.574985 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 19629
I20260809 23:23:01.582109 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:38991
--webserver_interface=127.1.235.190
--webserver_port=36325
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:38991
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:01.659160 20209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:01.659332 20209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:01.659353 20209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:01.660286 20209 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 23:23:01.660315 20209 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 23:23:01.660331 20209 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 23:23:01.660341 20209 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:01.660351 20209 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:01.660362 20209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:01.660378 20209 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:01.660388 20209 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:01.661700 20209 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:38991
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:38991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=36325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20209
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:01.661937 20209 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:01.662115 20209 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:01.666884 20220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:01.667013 20209 server_base.cc:1034] running on GCE node
W20260809 23:23:01.666960 20216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:01.666934 20218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:01.667375 20209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:01.667604 20209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:01.668781 20209 hybrid_clock.cc:648] HybridClock initialized: now 1786317781668771 us; error 28 us; skew 500 ppm
Aug 09 23:23:01 dist-test-slave-6nmv krb5kdc[19015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317781, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:01.675272 20209 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:23:01.675688 20209 webserver.cc:460] Webserver started at http://127.1.235.190:36325/ using document root <none> and password file <none>
I20260809 23:23:01.675933 20209 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:01.675979 20209 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:01.677297 20209 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:23:01.678143 20227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:01.678341 20209 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:23:01.678431 20209 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "e4d711b336ca4de6b485147f053fcf4e"
format_stamp: "Formatted at 2026-08-09 23:22:19 on dist-test-slave-6nmv"
server_key: "fd95cfb7c6c403a760038c792dce42c1"
server_key_iv: "493b7507417924de67a8dca61a1b2d35"
server_key_version: "encryptionkey@0"
I20260809 23:23:01.678704 20209 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:01.690698 20209 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:01.692549 20209 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:01.692656 20209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:01.696441 20209 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:38991
I20260809 23:23:01.696494 20283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:38991 every 8 connection(s)
I20260809 23:23:01.696808 20209 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:01.697396 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 20209
I20260809 23:23:01.697681 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:44037
--local_ip_for_outbound_sockets=127.1.235.129
--tserver_master_addrs=127.1.235.190:38991
--webserver_port=34251
--webserver_interface=127.1.235.129
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:23:01.698201 20284 sys_catalog.cc:263] Verifying existing consensus state
I20260809 23:23:01.698779 20284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: Bootstrap starting.
I20260809 23:23:01.707381 20284 log.cc:824] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:01.709206 20284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 23:23:01.709470 20284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: Bootstrap complete.
I20260809 23:23:01.711421 20284 raft_consensus.cc:348] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } }
I20260809 23:23:01.711668 20284 raft_consensus.cc:729] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4d711b336ca4de6b485147f053fcf4e, State: Initialized, Role: FOLLOWER
I20260809 23:23:01.711902 20284 consensus_queue.cc:260] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } }
I20260809 23:23:01.712002 20284 raft_consensus.cc:388] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:01.712056 20284 raft_consensus.cc:482] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:01.712102 20284 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 2 FOLLOWER]: Advancing to term 3
I20260809 23:23:01.713016 20284 raft_consensus.cc:504] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } }
I20260809 23:23:01.713129 20284 leader_election.cc:302] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e4d711b336ca4de6b485147f053fcf4e; no voters:
I20260809 23:23:01.713316 20284 leader_election.cc:288] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 23:23:01.713346 20289 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 3 FOLLOWER]: Leader election won for term 3
I20260809 23:23:01.713495 20289 raft_consensus.cc:686] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [term 3 LEADER]: Becoming Leader. State: Replica: e4d711b336ca4de6b485147f053fcf4e, State: Running, Role: LEADER
I20260809 23:23:01.713579 20284 sys_catalog.cc:564] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:01.713624 20289 consensus_queue.cc:237] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } }
I20260809 23:23:01.713938 20290 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "e4d711b336ca4de6b485147f053fcf4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } } }
I20260809 23:23:01.713936 20289 sys_catalog.cc:455] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e4d711b336ca4de6b485147f053fcf4e. Latest consensus state: current_term: 3 leader_uuid: "e4d711b336ca4de6b485147f053fcf4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e4d711b336ca4de6b485147f053fcf4e" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 38991 } } }
I20260809 23:23:01.714028 20290 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:01.714052 20289 sys_catalog.cc:458] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:01.715204 20306 catalog_manager.cc:1259] Loaded cluster ID: 7c6931eddbd04bb592a8a7bd8d8aa519
I20260809 23:23:01.715262 20306 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: loading cluster ID for follower catalog manager: success
I20260809 23:23:01.716014 20306 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e4d711b336ca4de6b485147f053fcf4e: acquiring CA information for follower catalog manager: success
F20260809 23:23:01.716303 20306 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f4053f519ad google::LogMessage::Fail() at ??:0
@ 0x7f4053f5488a google::LogMessage::SendToLog() at ??:0
@ 0x7f4053f514de google::LogMessage::Flush() at ??:0
@ 0x7f4053f52a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f40566be104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f405beaa6b9 kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7f405beaa989 kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7f405beaae4e kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7f405bead8c2 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7f4055e14954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f4056c786db start_thread at ??:0
@ 0x7f4052a4f61f clone at ??:0
W20260809 23:23:01.795872 20286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:01.796087 20286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:01.796118 20286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:01.797488 20286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:01.797540 20286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:01.797575 20286 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:23:01.799381 20286 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:44037
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=34251
--tserver_master_addrs=127.1.235.190:38991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:01.799594 20286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:01.799819 20286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:01.804598 20328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:01.804708 20329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:01.804752 20286 server_base.cc:1034] running on GCE node
W20260809 23:23:01.804623 20331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:01.805024 20286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:01.805270 20286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:01.806429 20286 hybrid_clock.cc:648] HybridClock initialized: now 1786317781806422 us; error 34 us; skew 500 ppm
Aug 09 23:23:01 dist-test-slave-6nmv krb5kdc[19015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317781, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:01.808689 20286 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:23:01.809104 20286 webserver.cc:460] Webserver started at http://127.1.235.129:34251/ using document root <none> and password file <none>
I20260809 23:23:01.809360 20286 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:01.809434 20286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:01.810742 20286 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:23:01.811473 20338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:01.811692 20286 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:23:01.811791 20286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "faa3bfc9fb31464e844af7555da8f0d8"
format_stamp: "Formatted at 2026-08-09 23:22:20 on dist-test-slave-6nmv"
server_key: "4e0579aed8d9e58e06a17411303eb6f1"
server_key_iv: "fa892f9cb2c875e3231d27287dedd826"
server_key_version: "encryptionkey@0"
I20260809 23:23:01.812083 20286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:01.822235 20286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:01.824452 20286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:01.824605 20286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:01.824817 20286 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:01.825207 20346 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260809 23:23:01.826848 20286 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 23:23:01.826941 20286 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260809 23:23:01.826982 20286 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 23:23:01.827539 20286 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 23:23:01.827592 20286 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260809 23:23:01.827659 20346 tablet_bootstrap.cc:492] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8: Bootstrap starting.
I20260809 23:23:01.834532 20286 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:44037
I20260809 23:23:01.834586 20462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:44037 every 8 connection(s)
I20260809 23:23:01.834903 20286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:23:01.838265 20346 log.cc:824] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:01.840474 20346 tablet_bootstrap.cc:492] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 23:23:01.840762 20346 tablet_bootstrap.cc:492] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8: Bootstrap complete.
I20260809 23:23:01.842006 20346 ts_tablet_manager.cc:1397] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.006s
I20260809 23:23:01.843426 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 20286
I20260809 23:23:01.843394 20346 raft_consensus.cc:348] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } } peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } }
I20260809 23:23:01.843672 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:43021
--local_ip_for_outbound_sockets=127.1.235.130
--tserver_master_addrs=127.1.235.190:38991
--webserver_port=46719
--webserver_interface=127.1.235.130
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:23:01.843686 20346 raft_consensus.cc:729] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: faa3bfc9fb31464e844af7555da8f0d8, State: Initialized, Role: FOLLOWER
I20260809 23:23:01.843811 20346 consensus_queue.cc:260] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } } peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } }
I20260809 23:23:01.844038 20346 ts_tablet_manager.cc:1428] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20260809 23:23:01.900859 20465 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:01.835614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:50949)
0809 23:23:01.835770 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:01.835809 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:01.836203 (+ 394us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:01.900638 (+ 64435us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":95,"threads_started":1}
W20260809 23:23:01.901142 20463 heartbeater.cc:644] Failed to heartbeat to 127.1.235.190:38991 (0 consecutive failures): Network error: Failed to ping master at 127.1.235.190:38991: Client connection negotiation failed: client connection to 127.1.235.190:38991: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 23:23:01.901569 20465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:01.901437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:54841)
0809 23:23:01.901494 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:01.901539 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 23:23:01.901953 20465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:01.901888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:58419)
0809 23:23:01.901913 (+ 25us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:01.901936 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260809 23:23:01.902081 20463 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 23:23:01.919128 20469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:01.919297 20469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:01.919320 20469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:01.920502 20469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:01.920555 20469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:01.920580 20469 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:23:01.922080 20469 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:43021
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=46719
--tserver_master_addrs=127.1.235.190:38991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20469
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:01.922259 20469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:01.922415 20469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:01.927057 20475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:01.927074 20478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:01.927078 20476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:01.927279 20469 server_base.cc:1034] running on GCE node
I20260809 23:23:01.927518 20469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:01.927685 20469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:01.928844 20469 hybrid_clock.cc:648] HybridClock initialized: now 1786317781928832 us; error 25 us; skew 500 ppm
Aug 09 23:23:01 dist-test-slave-6nmv krb5kdc[19015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317781, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:01.931268 20469 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:23:01.931717 20469 webserver.cc:460] Webserver started at http://127.1.235.130:46719/ using document root <none> and password file <none>
I20260809 23:23:01.931947 20469 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:01.932015 20469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:01.933245 20469 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:23:01.933949 20486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:01.934125 20469 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:23:01.934217 20469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65"
format_stamp: "Formatted at 2026-08-09 23:22:20 on dist-test-slave-6nmv"
server_key: "b3a9105bc1a0f22f46e420fa79a7f591"
server_key_iv: "e183e165b4581e1d73c00d735b2273ce"
server_key_version: "encryptionkey@0"
I20260809 23:23:01.934507 20469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:01.948616 20469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:01.950491 20469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:01.950644 20469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:01.950857 20469 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:01.951155 20469 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:01.951216 20469 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:01.951257 20469 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:01.951285 20469 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:01.957129 20469 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:43021
I20260809 23:23:01.957180 20616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:43021 every 8 connection(s)
I20260809 23:23:01.957525 20469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:23:01.958500 20619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:01.958152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:49967)
0809 23:23:01.958296 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:01.958366 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":68,"threads_started":1}
I20260809 23:23:01.958770 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 20469
W20260809 23:23:01.958930 20617 heartbeater.cc:644] Failed to heartbeat to 127.1.235.190:38991 (0 consecutive failures): Network error: Failed to ping master at 127.1.235.190:38991: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
I20260809 23:23:01.959060 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:41971
--local_ip_for_outbound_sockets=127.1.235.131
--tserver_master_addrs=127.1.235.190:38991
--webserver_port=33821
--webserver_interface=127.1.235.131
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:38203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:23:01.959230 20619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:01.959147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:47901)
0809 23:23:01.959185 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:01.959207 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260809 23:23:01.959506 20619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:01.959413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:52563)
0809 23:23:01.959466 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:01.959487 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 23:23:01.959605 20617 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 23:23:02.037544 20620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:02.037755 20620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:02.037777 20620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:02.038930 20620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:02.038975 20620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:02.039000 20620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:23:02.040338 20620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:38203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:41971
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=33821
--tserver_master_addrs=127.1.235.190:38991
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:02.040544 20620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:02.040768 20620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:02.045677 20628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:02.045644 20626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:02.045895 20620 server_base.cc:1034] running on GCE node
W20260809 23:23:02.045970 20625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:02.046183 20620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:02.046478 20620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:02.047621 20620 hybrid_clock.cc:648] HybridClock initialized: now 1786317782047605 us; error 35 us; skew 500 ppm
Aug 09 23:23:02 dist-test-slave-6nmv krb5kdc[19015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317782, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:02.050261 20620 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:23:02.050701 20620 webserver.cc:460] Webserver started at http://127.1.235.131:33821/ using document root <none> and password file <none>
I20260809 23:23:02.050926 20620 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:02.050994 20620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:02.052452 20620 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:23:02.053076 20639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:02.053287 20620 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260809 23:23:02.053392 20620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "120871e2438446ba95aa65546b1e80cc"
format_stamp: "Formatted at 2026-08-09 23:22:20 on dist-test-slave-6nmv"
server_key: "d76dd2abcf3e7a5991368997f321b797"
server_key_iv: "2d9e6e7fca071a54568ff73427aa2ac1"
server_key_version: "encryptionkey@0"
I20260809 23:23:02.053712 20620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:02.063731 20620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:02.065961 20620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:02.066114 20620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:02.066324 20620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:02.066614 20620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:02.066671 20620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:02.066709 20620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:02.066732 20620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:02.072504 20620 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:41971
I20260809 23:23:02.072548 20761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:41971 every 8 connection(s)
I20260809 23:23:02.072860 20620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:23:02.073855 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:02.073468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:42707)
0809 23:23:02.073618 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:02.073686 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":71,"threads_started":1}
I20260809 23:23:02.074191 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 20620
W20260809 23:23:02.074339 20762 heartbeater.cc:644] Failed to heartbeat to 127.1.235.190:38991 (0 consecutive failures): Network error: Failed to ping master at 127.1.235.190:38991: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
I20260809 23:23:02.074611 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:02.074517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:46095)
0809 23:23:02.074567 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:02.074594 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 23:23:02.074995 20764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:02.074870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:48505)
0809 23:23:02.074938 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:02.074968 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 23:23:02.075137 20762 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 23:23:02.902661 20766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:02.902432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:54949)
0809 23:23:02.902571 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:02.902603 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":85,"threads_started":1}
I20260809 23:23:02.960075 20767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:02.959873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:56729)
0809 23:23:02.959996 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:02.960029 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":58,"threads_started":1}
I20260809 23:23:03.075626 20768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:03.075422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:45257)
0809 23:23:03.075544 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:03.075576 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":56,"threads_started":1}
I20260809 23:23:03.305567 20769 raft_consensus.cc:482] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:23:03.305794 20769 raft_consensus.cc:504] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } } peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } }
I20260809 23:23:03.306201 20769 leader_election.cc:288] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021), 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971)
Aug 09 23:23:03 dist-test-slave-6nmv krb5kdc[19015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317781, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.130@KRBTEST.COM
Aug 09 23:23:03 dist-test-slave-6nmv krb5kdc[19015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317781, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.131@KRBTEST.COM
I20260809 23:23:03.316329 20766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:03.306320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:43021 (local address 127.1.235.129:43359)
0809 23:23:03.306364 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:03.306377 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:03.306450 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:03.307346 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:03.307348 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:03.307726 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:03.307914 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:03.307919 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:03.309046 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:03.309047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:03.309884 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:03.309886 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:03.310436 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:03.310436 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:03.310541 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:03.311193 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:03.311201 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:03.312850 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:03.314702 (+ 1852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:03.314709 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:03.314710 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:03.314967 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:03.315209 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:03.315210 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:03.315210 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:03.315334 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:03.315797 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:03.315804 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:03.315977 (+ 173us) client_negotiation.cc:769] Sending connection context
0809 23:23:03.316077 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 23:23:03.316210 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":44}
I20260809 23:23:03.316417 20771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:03.306423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:43359 (local address 127.1.235.130:43021)
0809 23:23:03.306615 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:03.306627 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:03.306662 (+ 35us) server_negotiation.cc:407] Connection header received
0809 23:23:03.307132 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:03.307134 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:03.307173 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:03.307282 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:03.308058 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:03.308930 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:03.309955 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:03.310323 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:03.310469 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:03.312975 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:03.312979 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:03.312979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:03.312990 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:03.314618 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:03.315045 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:03.315048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:03.315048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:03.315134 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:03.315405 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:03.315405 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:03.315405 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:03.315702 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:03.315805 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:03.316140 (+ 335us) server_negotiation.cc:299] Negotiation successful
0809 23:23:03.316283 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":80,"threads_started":1}
I20260809 23:23:03.316720 20772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:03.306546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:36073 (local address 127.1.235.131:41971)
0809 23:23:03.306695 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:03.306703 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:03.306742 (+ 39us) server_negotiation.cc:407] Connection header received
0809 23:23:03.307136 (+ 394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:03.307137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:03.307179 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:03.307314 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:03.308060 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:03.308929 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:03.309995 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:03.310323 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:03.310442 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:03.313508 (+ 3066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:03.313512 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:03.313512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:03.313530 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:03.315207 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:03.315545 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:03.315548 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:03.315548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:03.315640 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:03.315873 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:03.315874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:03.315874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:03.316190 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:03.316276 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:03.316469 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 23:23:03.316650 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":69,"threads_started":1}
I20260809 23:23:03.316602 20770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:03.306354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:41971 (local address 127.1.235.129:36073)
0809 23:23:03.306529 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:03.306537 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:03.306572 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:03.307377 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:03.307378 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:03.307729 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:03.307914 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:03.307919 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:03.309035 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:03.309036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:03.309890 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:03.309892 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:03.310434 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:03.310435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:03.310542 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:03.311204 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:03.311209 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:03.313419 (+ 2210us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:03.315259 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:03.315260 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:03.315260 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:03.315462 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:03.315704 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:03.315704 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:03.315704 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:03.315806 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:03.316266 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:03.316266 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:03.316305 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 23:23:03.316389 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 23:23:03.316496 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":37,"thread_start_us":51,"threads_started":1}
W20260809 23:23:03.317880 20340 leader_election.cc:341] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971): Not found: Tablet not found: fa02d323f0c447b898250e4ff076f351
W20260809 23:23:03.318007 20342 leader_election.cc:341] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021): Not found: Tablet not found: fa02d323f0c447b898250e4ff076f351
I20260809 23:23:03.318066 20342 leader_election.cc:302] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa3bfc9fb31464e844af7555da8f0d8; no voters: 120871e2438446ba95aa65546b1e80cc, a73ef7e62edf4afa9fd9dd2ac2e62c65
I20260809 23:23:03.318143 20769 raft_consensus.cc:2726] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:23:03.903317 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:03.903076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:38571)
0809 23:23:03.903239 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:03.903273 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":89,"threads_started":1}
I20260809 23:23:03.960702 20774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:03.960520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:48585)
0809 23:23:03.960632 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:03.960666 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":57,"threads_started":1}
I20260809 23:23:04.076254 20775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:04.076056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:47313)
0809 23:23:04.076187 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:04.076220 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":60,"threads_started":1}
I20260809 23:23:04.903930 20776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:04.903719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:60533)
0809 23:23:04.903853 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:04.903885 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":79,"threads_started":1}
I20260809 23:23:04.961302 20777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:04.961111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:60873)
0809 23:23:04.961241 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:04.961270 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":82,"threads_started":1}
I20260809 23:23:05.025230 20778 raft_consensus.cc:482] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:23:05.025321 20778 raft_consensus.cc:504] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } } peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } }
I20260809 23:23:05.025511 20778 leader_election.cc:288] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021), 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971)
W20260809 23:23:05.025985 20342 leader_election.cc:341] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021): Not found: Tablet not found: fa02d323f0c447b898250e4ff076f351
W20260809 23:23:05.026049 20340 leader_election.cc:341] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971): Not found: Tablet not found: fa02d323f0c447b898250e4ff076f351
I20260809 23:23:05.026088 20340 leader_election.cc:302] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa3bfc9fb31464e844af7555da8f0d8; no voters: 120871e2438446ba95aa65546b1e80cc, a73ef7e62edf4afa9fd9dd2ac2e62c65
I20260809 23:23:05.026163 20778 raft_consensus.cc:2726] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:23:05.076886 20779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:05.076678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:45895)
0809 23:23:05.076819 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:05.076851 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":76,"threads_started":1}
I20260809 23:23:05.904716 20780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:05.904493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:33463)
0809 23:23:05.904643 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:05.904675 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":84,"threads_started":1}
I20260809 23:23:05.961922 20781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:05.961700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:43669)
0809 23:23:05.961842 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:05.961874 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":72,"threads_started":1}
I20260809 23:23:06.077471 20782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:06.077303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:53947)
0809 23:23:06.077408 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:06.077437 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":58,"threads_started":1}
I20260809 23:23:06.905455 20784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:06.905175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:40737)
0809 23:23:06.905335 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:06.905370 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":83,"threads_started":1}
I20260809 23:23:06.962509 20785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:06.962328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:51801)
0809 23:23:06.962438 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:06.962471 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":55,"threads_started":1}
I20260809 23:23:07.078076 20786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:07.077870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:54389)
0809 23:23:07.078011 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:07.078042 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":85,"threads_started":1}
I20260809 23:23:07.777070 20787 raft_consensus.cc:482] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:23:07.777163 20787 raft_consensus.cc:504] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } } peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } }
I20260809 23:23:07.777475 20787 leader_election.cc:288] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021), 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971)
W20260809 23:23:07.777894 20340 leader_election.cc:341] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971): Not found: Tablet not found: fa02d323f0c447b898250e4ff076f351
W20260809 23:23:07.777982 20342 leader_election.cc:341] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021): Not found: Tablet not found: fa02d323f0c447b898250e4ff076f351
I20260809 23:23:07.778025 20342 leader_election.cc:302] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa3bfc9fb31464e844af7555da8f0d8; no voters: 120871e2438446ba95aa65546b1e80cc, a73ef7e62edf4afa9fd9dd2ac2e62c65
I20260809 23:23:07.778115 20787 raft_consensus.cc:2726] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:23:07.906136 20788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:07.905934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:59183)
0809 23:23:07.906055 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:07.906088 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":56,"threads_started":1}
I20260809 23:23:07.963172 20789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:07.962937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:58843)
0809 23:23:07.963084 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:07.963132 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":79,"threads_started":1}
I20260809 23:23:08.078701 20791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:08.078467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:43995)
0809 23:23:08.078618 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:08.078659 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":77,"threads_started":1}
I20260809 23:23:08.906813 20792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:08.906617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:52507)
0809 23:23:08.906742 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:08.906770 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":75,"threads_started":1}
I20260809 23:23:08.963718 20793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:08.963535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:49911)
0809 23:23:08.963660 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:08.963687 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":75,"threads_started":1}
I20260809 23:23:09.079324 20794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:09.079127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:37397)
0809 23:23:09.079255 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:09.079286 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":72,"threads_started":1}
I20260809 23:23:09.907464 20795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:09.907242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:46811)
0809 23:23:09.907383 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:09.907421 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":79,"threads_started":1}
I20260809 23:23:09.964387 20796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:09.964190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:46129)
0809 23:23:09.964321 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:09.964355 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":70,"threads_started":1}
I20260809 23:23:10.080009 20797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:10.079762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:45833)
0809 23:23:10.079930 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:10.079968 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":82,"threads_started":1}
I20260809 23:23:10.908084 20798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:10.907858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:43711)
0809 23:23:10.908008 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:10.908041 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":65,"threads_started":1}
I20260809 23:23:10.965006 20799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:10.964772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:52607)
0809 23:23:10.964903 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:10.964943 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":72,"threads_started":1}
I20260809 23:23:11.080624 20800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:11.080440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:40423)
0809 23:23:11.080561 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:11.080591 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":63,"threads_started":1}
I20260809 23:23:11.282562 20802 raft_consensus.cc:482] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:23:11.282649 20802 raft_consensus.cc:504] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } } peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } }
I20260809 23:23:11.282807 20802 leader_election.cc:288] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021), 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971)
W20260809 23:23:11.283188 20342 leader_election.cc:341] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021): Not found: Tablet not found: fa02d323f0c447b898250e4ff076f351
W20260809 23:23:11.283290 20340 leader_election.cc:341] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971): Not found: Tablet not found: fa02d323f0c447b898250e4ff076f351
I20260809 23:23:11.283350 20340 leader_election.cc:302] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa3bfc9fb31464e844af7555da8f0d8; no voters: 120871e2438446ba95aa65546b1e80cc, a73ef7e62edf4afa9fd9dd2ac2e62c65
I20260809 23:23:11.283443 20802 raft_consensus.cc:2726] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:23:11.908824 20804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:11.908587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:36837)
0809 23:23:11.908745 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:11.908780 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":63,"threads_started":1}
I20260809 23:23:11.965605 20805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:11.965423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:41255)
0809 23:23:11.965533 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:11.965567 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":56,"threads_started":1}
I20260809 23:23:12.081267 20806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:12.081038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:37111)
0809 23:23:12.081181 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:12.081215 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":84,"threads_started":1}
I20260809 23:23:12.909492 20807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:12.909273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:45833)
0809 23:23:12.909404 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:12.909447 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":59,"threads_started":1}
I20260809 23:23:12.966193 20808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:12.966007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:56231)
0809 23:23:12.966122 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:12.966155 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":52,"threads_started":1}
I20260809 23:23:13.082041 20809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:13.081747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:41975)
0809 23:23:13.081954 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:13.081993 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":115,"threads_started":1}
I20260809 23:23:13.910157 20810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:13.909929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:40783)
0809 23:23:13.910055 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:13.910086 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":68,"threads_started":1}
I20260809 23:23:13.966799 20811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:13.966585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:47669)
0809 23:23:13.966731 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:13.966763 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":87,"threads_started":1}
I20260809 23:23:14.082646 20813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:14.082454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:44515)
0809 23:23:14.082578 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:14.082610 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":62,"threads_started":1}
I20260809 23:23:14.910841 20814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:14.910618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:37021)
0809 23:23:14.910768 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:14.910798 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
I20260809 23:23:14.967345 20815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:14.967178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:37223)
0809 23:23:14.967280 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:14.967312 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":49,"threads_started":1}
I20260809 23:23:15.083254 20816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:15.083059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:43035)
0809 23:23:15.083187 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:15.083219 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":76,"threads_started":1}
I20260809 23:23:15.638998 20817 raft_consensus.cc:482] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:23:15.639086 20817 raft_consensus.cc:504] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a73ef7e62edf4afa9fd9dd2ac2e62c65" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 43021 } } peers { permanent_uuid: "120871e2438446ba95aa65546b1e80cc" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 41971 } } peers { permanent_uuid: "faa3bfc9fb31464e844af7555da8f0d8" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 44037 } }
I20260809 23:23:15.639278 20817 leader_election.cc:288] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021), 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971)
W20260809 23:23:15.639673 20342 leader_election.cc:341] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a73ef7e62edf4afa9fd9dd2ac2e62c65 (127.1.235.130:43021): Not found: Tablet not found: fa02d323f0c447b898250e4ff076f351
W20260809 23:23:15.639751 20340 leader_election.cc:341] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 120871e2438446ba95aa65546b1e80cc (127.1.235.131:41971): Not found: Tablet not found: fa02d323f0c447b898250e4ff076f351
I20260809 23:23:15.639798 20340 leader_election.cc:302] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa3bfc9fb31464e844af7555da8f0d8; no voters: 120871e2438446ba95aa65546b1e80cc, a73ef7e62edf4afa9fd9dd2ac2e62c65
I20260809 23:23:15.639864 20817 raft_consensus.cc:2726] T fa02d323f0c447b898250e4ff076f351 P faa3bfc9fb31464e844af7555da8f0d8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 23:23:15.911589 20818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:15.911350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:54975)
0809 23:23:15.911509 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:15.911543 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":96,"threads_started":1}
I20260809 23:23:15.967996 20819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:15.967713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:58109)
0809 23:23:15.967926 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:15.967959 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":68,"threads_started":1}
I20260809 23:23:16.083911 20820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:16.083708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:55893)
0809 23:23:16.083846 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:16.083874 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":87,"threads_started":1}
I20260809 23:23:16.912384 20821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:16.912139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.129:35585)
0809 23:23:16.912293 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:16.912330 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":67,"threads_started":1}
I20260809 23:23:16.968751 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:16.968530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.130:48629)
0809 23:23:16.968666 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:16.968703 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":74,"threads_started":1}
I20260809 23:23:17.081836 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 20286
I20260809 23:23:17.085919 20823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:17.085689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:38991 (local address 127.1.235.131:38163)
0809 23:23:17.085836 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:17.085872 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.190:38991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":75,"threads_started":1}
I20260809 23:23:17.089610 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 20469
I20260809 23:23:17.095708 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 20620
2026-08-09T23:23:17Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58397 ms)
[----------] 30 tests from SecurityITest (257950 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:17 dist-test-slave-6nmv krb5kdc[20827](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:17 dist-test-slave-6nmv krb5kdc[20827](info): set up 2 sockets
Aug 09 23:23:17 dist-test-slave-6nmv krb5kdc[20827](info): commencing operation
krb5kdc: starting...
W20260809 23:23:18.134768 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.016s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:18 dist-test-slave-6nmv krb5kdc[20827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:23:18.245400 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:43761
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:42179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:43761
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:18.321274 20842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:18.321475 20842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:18.321511 20842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:18.322501 20842 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:18.322561 20842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:18.322583 20842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:18.322602 20842 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:18.322650 20842 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:18.324103 20842 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:42179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:43761
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:43761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20842
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:18.324354 20842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:18.324554 20842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:18.329137 20848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:18.329164 20850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:18.329319 20842 server_base.cc:1034] running on GCE node
W20260809 23:23:18.329182 20847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:18.329664 20842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:18.329954 20842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:18.331108 20842 hybrid_clock.cc:648] HybridClock initialized: now 1786317798331101 us; error 37 us; skew 500 ppm
Aug 09 23:23:18 dist-test-slave-6nmv krb5kdc[20827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317798, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:18.337541 20842 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:23:18.338076 20842 webserver.cc:460] Webserver started at http://127.1.235.190:42427/ using document root <none> and password file <none>
I20260809 23:23:18.338310 20842 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:18.338371 20842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:18.338518 20842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:18.339476 20842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "fedd1e99e67b427ea8b6b82604fade2c"
format_stamp: "Formatted at 2026-08-09 23:23:18 on dist-test-slave-6nmv"
server_key: "5234a10d20f1a3586ab9a543cbfeddde"
server_key_iv: "e3c2e8960d3b29530d9b09682c936b39"
server_key_version: "encryptionkey@0"
I20260809 23:23:18.339816 20842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "fedd1e99e67b427ea8b6b82604fade2c"
format_stamp: "Formatted at 2026-08-09 23:23:18 on dist-test-slave-6nmv"
server_key: "5234a10d20f1a3586ab9a543cbfeddde"
server_key_iv: "e3c2e8960d3b29530d9b09682c936b39"
server_key_version: "encryptionkey@0"
I20260809 23:23:18.341120 20842 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:23:18.341897 20858 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:18.342093 20842 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:23:18.342186 20842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "fedd1e99e67b427ea8b6b82604fade2c"
format_stamp: "Formatted at 2026-08-09 23:23:18 on dist-test-slave-6nmv"
server_key: "5234a10d20f1a3586ab9a543cbfeddde"
server_key_iv: "e3c2e8960d3b29530d9b09682c936b39"
server_key_version: "encryptionkey@0"
I20260809 23:23:18.342267 20842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:18.369648 20842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:18.371981 20842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:18.372148 20842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:18.376363 20842 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:43761
I20260809 23:23:18.376412 20917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:43761 every 8 connection(s)
I20260809 23:23:18.376787 20842 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:18.377671 20918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:18.379467 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 20842
I20260809 23:23:18.379587 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:18.379781 1966 external_mini_cluster.cc:1428] Setting key 781e8b270adb897240938f69e1d4f7f4
I20260809 23:23:18.380406 20918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c: Bootstrap starting.
I20260809 23:23:18.381065 20918 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:18.381450 20918 log.cc:824] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:18.382225 20918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c: No bootstrap required, opened a new log
I20260809 23:23:18.384461 20918 raft_consensus.cc:348] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fedd1e99e67b427ea8b6b82604fade2c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43761 } }
I20260809 23:23:18.384635 20918 raft_consensus.cc:374] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:18.384677 20918 raft_consensus.cc:729] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fedd1e99e67b427ea8b6b82604fade2c, State: Initialized, Role: FOLLOWER
I20260809 23:23:18.384825 20918 consensus_queue.cc:260] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fedd1e99e67b427ea8b6b82604fade2c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43761 } }
I20260809 23:23:18.384943 20918 raft_consensus.cc:388] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:18.384969 20918 raft_consensus.cc:482] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:18.385048 20918 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:18.385896 20918 raft_consensus.cc:504] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fedd1e99e67b427ea8b6b82604fade2c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43761 } }
I20260809 23:23:18.386023 20918 leader_election.cc:302] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fedd1e99e67b427ea8b6b82604fade2c; no voters:
I20260809 23:23:18.386202 20918 leader_election.cc:288] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:18.386260 20923 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:18.386441 20923 raft_consensus.cc:686] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [term 1 LEADER]: Becoming Leader. State: Replica: fedd1e99e67b427ea8b6b82604fade2c, State: Running, Role: LEADER
I20260809 23:23:18.386499 20918 sys_catalog.cc:564] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:18.386615 20923 consensus_queue.cc:237] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fedd1e99e67b427ea8b6b82604fade2c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43761 } }
I20260809 23:23:18.386981 20925 sys_catalog.cc:455] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fedd1e99e67b427ea8b6b82604fade2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fedd1e99e67b427ea8b6b82604fade2c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43761 } } }
I20260809 23:23:18.386973 20923 sys_catalog.cc:455] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader fedd1e99e67b427ea8b6b82604fade2c. Latest consensus state: current_term: 1 leader_uuid: "fedd1e99e67b427ea8b6b82604fade2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fedd1e99e67b427ea8b6b82604fade2c" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43761 } } }
I20260809 23:23:18.387077 20925 sys_catalog.cc:458] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:18.387084 20923 sys_catalog.cc:458] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c [sys.catalog]: This master's current role is: LEADER
Aug 09 23:23:18 dist-test-slave-6nmv krb5kdc[20827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:18.387444 20930 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:18.387938 20930 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:18.389658 20930 catalog_manager.cc:1347] Generated new cluster ID: 66c6f00ccfb14756894a60a20bd026fe
I20260809 23:23:18.389710 20930 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:18.391136 20921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:18.380367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41068 (local address 127.1.235.190:43761)
0809 23:23:18.380550 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:18.380559 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:18.380595 (+ 36us) server_negotiation.cc:407] Connection header received
0809 23:23:18.380985 (+ 390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:18.380991 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:18.381030 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:18.381134 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:18.382052 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.382984 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.384152 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.384523 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.384598 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:18.387735 (+ 3137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:18.387739 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:18.387739 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:18.387749 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:18.389536 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:18.389983 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:18.389986 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:18.389987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:18.390093 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:18.390296 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:18.390296 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:18.390297 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:18.390581 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:18.390729 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:18.390814 (+ 85us) server_negotiation.cc:299] Negotiation successful
0809 23:23:18.390938 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":101,"threads_started":1}
I20260809 23:23:18.399140 20930 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:18.399627 20930 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:18.403648 20930 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c: Generated new TSK 0
I20260809 23:23:18.403818 20930 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:23:18.437959 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:43761
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:42179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:18.532481 20949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:18.532683 20949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:18.532727 20949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:18.533965 20949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:18.534003 20949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:18.534037 20949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:23:18.535329 20949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:42179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:43761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:18.535553 20949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:18.535802 20949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:18.540191 20960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:18.540253 20957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:18.540192 20954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:18.540373 20949 server_base.cc:1034] running on GCE node
I20260809 23:23:18.540565 20949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:18.540779 20949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:18.541934 20949 hybrid_clock.cc:648] HybridClock initialized: now 1786317798541921 us; error 40 us; skew 500 ppm
Aug 09 23:23:18 dist-test-slave-6nmv krb5kdc[20827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317798, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:18.544423 20949 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:23:18.544885 20949 webserver.cc:460] Webserver started at http://127.1.235.129:40597/ using document root <none> and password file <none>
I20260809 23:23:18.545105 20949 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:18.545186 20949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:18.545318 20949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:18.546288 20949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "df541f6b32924e4d95f2e7e9df65f890"
format_stamp: "Formatted at 2026-08-09 23:23:18 on dist-test-slave-6nmv"
server_key: "b183dc647076106ba920b4537a9f6015"
server_key_iv: "cef38275315fd95b33d06b5253cfed41"
server_key_version: "encryptionkey@0"
I20260809 23:23:18.546558 20949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "df541f6b32924e4d95f2e7e9df65f890"
format_stamp: "Formatted at 2026-08-09 23:23:18 on dist-test-slave-6nmv"
server_key: "b183dc647076106ba920b4537a9f6015"
server_key_iv: "cef38275315fd95b33d06b5253cfed41"
server_key_version: "encryptionkey@0"
I20260809 23:23:18.547631 20949 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:23:18.548228 20967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:18.548396 20949 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:18.548493 20949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "df541f6b32924e4d95f2e7e9df65f890"
format_stamp: "Formatted at 2026-08-09 23:23:18 on dist-test-slave-6nmv"
server_key: "b183dc647076106ba920b4537a9f6015"
server_key_iv: "cef38275315fd95b33d06b5253cfed41"
server_key_version: "encryptionkey@0"
I20260809 23:23:18.548569 20949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:18.558578 20949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:18.560374 20949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:18.560523 20949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:18.560724 20949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:18.561003 20949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:18.561058 20949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:18.561090 20949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:18.561115 20949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:18.567008 20949 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:37603
I20260809 23:23:18.567057 21089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:37603 every 8 connection(s)
I20260809 23:23:18.567299 20949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
Aug 09 23:23:18 dist-test-slave-6nmv krb5kdc[20827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317798, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:18.573298 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 20949
I20260809 23:23:18.573390 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:23:18.573597 1966 external_mini_cluster.cc:1428] Setting key 9ba9f64e5a5c3a41830a9e7950b54a3f
I20260809 23:23:18.576579 21093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:18.567915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:43761 (local address 127.1.235.129:33239)
0809 23:23:18.568116 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:18.568165 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:18.568610 (+ 445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:18.568795 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:18.568798 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:18.569294 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:18.569474 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:18.569479 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.570192 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.570193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:18.571055 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:18.571058 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.571435 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.571436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:18.571535 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:18.571988 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:18.571995 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:18.573393 (+ 1398us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:18.575072 (+ 1679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:18.575080 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:18.575081 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:18.575408 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:18.575619 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:18.575620 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:18.575621 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:18.575759 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:18.576022 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:18.576029 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:18.576185 (+ 156us) client_negotiation.cc:769] Sending connection context
0809 23:23:18.576318 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 23:23:18.576437 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":84,"threads_started":1}
I20260809 23:23:18.576579 20921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:18.567966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:33239 (local address 127.1.235.190:43761)
0809 23:23:18.568057 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:18.568059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:18.568228 (+ 169us) server_negotiation.cc:407] Connection header received
0809 23:23:18.568690 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:18.568691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:18.568700 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:18.568748 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:18.569550 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.570097 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.571167 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.571350 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.571410 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:18.573524 (+ 2114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:18.573526 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:18.573526 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:18.573535 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:18.574992 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:18.575505 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:18.575505 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:18.575506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:18.575557 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:18.575826 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:18.575826 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:18.575826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:18.575927 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:18.576018 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:18.576364 (+ 346us) server_negotiation.cc:299] Negotiation successful
0809 23:23:18.576461 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 23:23:18.578056 21090 heartbeater.cc:347] Connected to a master server at 127.1.235.190:43761
I20260809 23:23:18.578204 21090 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:18.578411 21090 heartbeater.cc:511] Master 127.1.235.190:43761 requested a full tablet report, sending...
I20260809 23:23:18.578974 20877 ts_manager.cc:194] Registered new tserver with Master: df541f6b32924e4d95f2e7e9df65f890 (127.1.235.129:37603)
I20260809 23:23:18.579610 20877 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:33239
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:23:18.599993 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:43761
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:42179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:18.674290 21096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:18.674443 21096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:18.674461 21096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:18.675410 21096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:18.675446 21096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:18.675467 21096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:23:18.676653 21096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:42179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:43761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:18.676851 21096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:18.677045 21096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 23:23:18.681509 21096 server_base.cc:1034] running on GCE node
W20260809 23:23:18.681497 21102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:18.681478 21101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:18.681471 21104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:18.681918 21096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:18.682207 21096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:18.683436 21096 hybrid_clock.cc:648] HybridClock initialized: now 1786317798683425 us; error 38 us; skew 500 ppm
Aug 09 23:23:18 dist-test-slave-6nmv krb5kdc[20827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317798, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:18.686012 21096 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:23:18.686430 21096 webserver.cc:460] Webserver started at http://127.1.235.130:40491/ using document root <none> and password file <none>
I20260809 23:23:18.686587 21096 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:18.686623 21096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:18.686702 21096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:18.687711 21096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "692cc200ceb34840a729f65c1c6bd0a7"
format_stamp: "Formatted at 2026-08-09 23:23:18 on dist-test-slave-6nmv"
server_key: "0c7b7782a798d2feb3c96e9a3db3f77b"
server_key_iv: "a6638f42868af6641aee44403ffb574f"
server_key_version: "encryptionkey@0"
I20260809 23:23:18.687983 21096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "692cc200ceb34840a729f65c1c6bd0a7"
format_stamp: "Formatted at 2026-08-09 23:23:18 on dist-test-slave-6nmv"
server_key: "0c7b7782a798d2feb3c96e9a3db3f77b"
server_key_iv: "a6638f42868af6641aee44403ffb574f"
server_key_version: "encryptionkey@0"
I20260809 23:23:18.689270 21096 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 23:23:18.690014 21114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:18.690164 21096 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:18.690244 21096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "692cc200ceb34840a729f65c1c6bd0a7"
format_stamp: "Formatted at 2026-08-09 23:23:18 on dist-test-slave-6nmv"
server_key: "0c7b7782a798d2feb3c96e9a3db3f77b"
server_key_iv: "a6638f42868af6641aee44403ffb574f"
server_key_version: "encryptionkey@0"
I20260809 23:23:18.690302 21096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:18.728767 21096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:18.730314 21096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:18.730412 21096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:18.730557 21096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:18.730782 21096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:18.730810 21096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:18.730829 21096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:18.730839 21096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:18.736064 21096 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:45429
I20260809 23:23:18.736145 21237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:45429 every 8 connection(s)
I20260809 23:23:18.736416 21096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
Aug 09 23:23:18 dist-test-slave-6nmv krb5kdc[20827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317798, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:18.744975 20921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:18.737060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:44133 (local address 127.1.235.190:43761)
0809 23:23:18.737100 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:18.737102 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:18.737309 (+ 207us) server_negotiation.cc:407] Connection header received
0809 23:23:18.737792 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:18.737794 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:18.737822 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:18.737869 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:18.738705 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.739160 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.740178 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.740375 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.740466 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:18.742411 (+ 1945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:18.742412 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:18.742412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:18.742420 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:18.743631 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:18.744060 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:18.744061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:18.744062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:18.744119 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:18.744357 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:18.744358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:18.744358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:18.744483 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:18.744555 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:18.744807 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 23:23:18.744882 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 23:23:18.745103 21240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:18.737038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:43761 (local address 127.1.235.130:44133)
0809 23:23:18.737202 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:18.737233 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:18.737690 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:18.737940 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:18.737944 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:18.738457 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:18.738610 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:18.738614 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.739321 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.739322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:18.740083 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:18.740085 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.740478 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.740479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:18.740594 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:18.740997 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:18.741005 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:18.742317 (+ 1312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:18.743719 (+ 1402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:18.743726 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:18.743728 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:18.743962 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:18.744195 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:18.744196 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:18.744196 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:18.744289 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:18.744547 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:18.744553 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:18.744677 (+ 124us) client_negotiation.cc:769] Sending connection context
0809 23:23:18.744772 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 23:23:18.744909 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":83,"threads_started":1}
I20260809 23:23:18.745468 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 21096
I20260809 23:23:18.745579 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:23:18.745607 21238 heartbeater.cc:347] Connected to a master server at 127.1.235.190:43761
I20260809 23:23:18.745687 21238 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:18.745790 1966 external_mini_cluster.cc:1428] Setting key 26515da88db2f8d499e344b01799dd51
I20260809 23:23:18.745894 21238 heartbeater.cc:511] Master 127.1.235.190:43761 requested a full tablet report, sending...
I20260809 23:23:18.746227 20876 ts_manager.cc:194] Registered new tserver with Master: 692cc200ceb34840a729f65c1c6bd0a7 (127.1.235.130:45429)
I20260809 23:23:18.746676 20876 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:44133
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:23:18.768414 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:43761
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:42179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:18.843699 21243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:18.843888 21243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:18.843911 21243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:18.845119 21243 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:18.845157 21243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:18.845202 21243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:23:18.846580 21243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:42179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:43761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:18.846797 21243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:18.847034 21243 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:18.851577 21251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:18.851619 21252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:18.851581 21254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:18.851735 21243 server_base.cc:1034] running on GCE node
I20260809 23:23:18.851996 21243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:18.852336 21243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:18.853505 21243 hybrid_clock.cc:648] HybridClock initialized: now 1786317798853495 us; error 24 us; skew 500 ppm
Aug 09 23:23:18 dist-test-slave-6nmv krb5kdc[20827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317798, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:18.855749 21243 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:23:18.856146 21243 webserver.cc:460] Webserver started at http://127.1.235.131:38081/ using document root <none> and password file <none>
I20260809 23:23:18.856359 21243 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:18.856422 21243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:18.856563 21243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:18.857484 21243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "354e77d7fd014201be18b6b6e2ae472b"
format_stamp: "Formatted at 2026-08-09 23:23:18 on dist-test-slave-6nmv"
server_key: "1ec174d2aa97d59e53dbd3dae90bb4bb"
server_key_iv: "32ab1842d3ddeda0dd92c4608c4a8325"
server_key_version: "encryptionkey@0"
I20260809 23:23:18.857888 21243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "354e77d7fd014201be18b6b6e2ae472b"
format_stamp: "Formatted at 2026-08-09 23:23:18 on dist-test-slave-6nmv"
server_key: "1ec174d2aa97d59e53dbd3dae90bb4bb"
server_key_iv: "32ab1842d3ddeda0dd92c4608c4a8325"
server_key_version: "encryptionkey@0"
I20260809 23:23:18.859098 21243 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:23:18.859756 21263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:18.859918 21243 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:23:18.860004 21243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "354e77d7fd014201be18b6b6e2ae472b"
format_stamp: "Formatted at 2026-08-09 23:23:18 on dist-test-slave-6nmv"
server_key: "1ec174d2aa97d59e53dbd3dae90bb4bb"
server_key_iv: "32ab1842d3ddeda0dd92c4608c4a8325"
server_key_version: "encryptionkey@0"
I20260809 23:23:18.860080 21243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:18.875795 21243 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:18.877321 21243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:18.877485 21243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:18.877705 21243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:18.878060 21243 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:18.878127 21243 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:18.878163 21243 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:18.878185 21243 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:18.883297 21243 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:35927
I20260809 23:23:18.883342 21386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:35927 every 8 connection(s)
I20260809 23:23:18.883620 21243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
Aug 09 23:23:18 dist-test-slave-6nmv krb5kdc[20827](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317798, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:18.891714 20921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:18.884222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:41699 (local address 127.1.235.190:43761)
0809 23:23:18.884258 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:18.884260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:18.884432 (+ 172us) server_negotiation.cc:407] Connection header received
0809 23:23:18.884855 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:18.884857 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:18.884869 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:18.884932 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:18.885722 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.886248 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.887213 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.887398 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.887484 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:18.889463 (+ 1979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:18.889464 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:18.889464 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:18.889470 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:18.890549 (+ 1079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:18.890895 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:18.890896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:18.890897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:18.890978 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:18.891201 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:18.891202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:18.891202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:18.891328 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:18.891378 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:18.891571 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 23:23:18.891639 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 23:23:18.891844 21389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:18.884191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:43761 (local address 127.1.235.131:41699)
0809 23:23:18.884308 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:18.884349 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:18.884762 (+ 413us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:18.884988 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:18.884991 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:18.885473 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:18.885620 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:18.885624 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.886372 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.886372 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:18.887117 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:18.887119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.887500 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.887501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:18.887588 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:18.888048 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:18.888056 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:18.889349 (+ 1293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:18.890625 (+ 1276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:18.890632 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:18.890634 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:18.890824 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:18.891046 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:18.891047 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:18.891047 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:18.891136 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:18.891381 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:18.891385 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:18.891475 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 23:23:18.891543 (+ 68us) client_negotiation.cc:240] Negotiation successful
0809 23:23:18.891651 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":59,"threads_started":1}
I20260809 23:23:18.892352 21387 heartbeater.cc:347] Connected to a master server at 127.1.235.190:43761
I20260809 23:23:18.892464 21387 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:18.892531 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 21243
I20260809 23:23:18.892629 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:23:18.892666 21387 heartbeater.cc:511] Master 127.1.235.190:43761 requested a full tablet report, sending...
I20260809 23:23:18.892827 1966 external_mini_cluster.cc:1428] Setting key 34eb5ef880bdffb479f1f9f0c3219e91
I20260809 23:23:18.893061 20876 ts_manager.cc:194] Registered new tserver with Master: 354e77d7fd014201be18b6b6e2ae472b (127.1.235.131:35927)
I20260809 23:23:18.893572 20876 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:41699
I20260809 23:23:18.893651 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:23:18.899887 20921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:18.894981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41080 (local address 127.1.235.190:43761)
0809 23:23:18.895026 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:18.895028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:18.895090 (+ 62us) server_negotiation.cc:407] Connection header received
0809 23:23:18.895132 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:18.895133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:18.895139 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:18.895184 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:18.895598 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.895962 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.896615 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.896768 (+ 153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.896836 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:18.897752 (+ 916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:18.897753 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:18.897753 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:18.897759 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:18.899101 (+ 1342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:18.899374 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:18.899375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:18.899375 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:18.899422 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:18.899557 (+ 135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:18.899557 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:18.899557 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:18.899653 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:18.899722 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:18.899792 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 23:23:18.899840 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 23:23:18.901284 20876 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41080:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:23:18.902863 20876 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:23:18.909219 21398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:18.905035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:35927 (local address 127.0.0.1:33284)
0809 23:23:18.905524 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:18.905571 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:18.905643 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:18.905898 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:18.905901 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:18.905905 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:18.905966 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:18.905968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.907241 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.907242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:18.908252 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:18.908254 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.908978 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.908979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:18.909025 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:18.909033 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 23:23:18.909107 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 23:23:18.909154 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"mutex_wait_us":4,"thread_start_us":46,"threads_started":1}
I20260809 23:23:18.909224 21402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:18.905309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33284 (local address 127.1.235.131:35927)
0809 23:23:18.905514 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:18.905517 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:18.905637 (+ 120us) server_negotiation.cc:407] Connection header received
0809 23:23:18.905710 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:18.905711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:18.905725 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:18.905802 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:18.906041 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.907148 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.908307 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.908903 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.908974 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:18.909023 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:18.909123 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 23:23:18.909159 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":137,"threads_started":1}
I20260809 23:23:18.909799 21401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:18.905036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:45429 (local address 127.0.0.1:50622)
0809 23:23:18.905524 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:18.905571 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:18.905643 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:18.905898 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:18.905901 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:18.905903 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:18.905964 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:18.905966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.907245 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.907246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:18.908173 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:18.908176 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.909606 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.909607 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:18.909661 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:18.909664 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:23:18.909711 (+ 47us) client_negotiation.cc:240] Negotiation successful
0809 23:23:18.909744 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"mutex_wait_us":19,"thread_start_us":48,"threads_started":1}
I20260809 23:23:18.909878 21400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:18.905129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50622 (local address 127.1.235.130:45429)
0809 23:23:18.905288 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:18.905292 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:18.905640 (+ 348us) server_negotiation.cc:407] Connection header received
0809 23:23:18.905712 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:18.905713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:18.905725 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:18.905802 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:18.906046 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.907124 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.908258 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.908903 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.908974 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:18.909023 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:18.909740 (+ 717us) server_negotiation.cc:299] Negotiation successful
0809 23:23:18.909781 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
I20260809 23:23:18.909989 21399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:18.905222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:37603 (local address 127.0.0.1:59876)
0809 23:23:18.905725 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:18.905732 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:18.905771 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:18.906070 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:18.906071 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:18.906073 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:18.906133 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:18.906134 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.907007 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.907008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:18.908236 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:18.908239 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.909624 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.909625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:18.909691 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:18.909696 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 23:23:18.909743 (+ 47us) client_negotiation.cc:240] Negotiation successful
0809 23:23:18.909780 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":496,"mutex_wait_us":23,"thread_start_us":36,"threads_started":1}
I20260809 23:23:18.909930 21315 tablet_service.cc:1467] Processing CreateTablet for tablet 5bae39d22304487182d31daf0c36500f (DEFAULT_TABLE table=test-table [id=b9ab56cf8fb04d1086f57d77ef7f117b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:18.910228 21315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bae39d22304487182d31daf0c36500f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:18.910310 21403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:18.905337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59876 (local address 127.1.235.129:37603)
0809 23:23:18.905593 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:18.905596 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:18.905776 (+ 180us) server_negotiation.cc:407] Connection header received
0809 23:23:18.905911 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:18.905914 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:18.905929 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:18.905993 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:18.906210 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.906894 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.909057 (+ 2163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:18.909542 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:18.909622 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:18.909670 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:18.909863 (+ 193us) server_negotiation.cc:299] Negotiation successful
0809 23:23:18.910229 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":109,"threads_started":1}
I20260809 23:23:18.910773 21020 tablet_service.cc:1467] Processing CreateTablet for tablet 5bae39d22304487182d31daf0c36500f (DEFAULT_TABLE table=test-table [id=b9ab56cf8fb04d1086f57d77ef7f117b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:18.911033 21020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bae39d22304487182d31daf0c36500f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:18.912551 21404 tablet_bootstrap.cc:492] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b: Bootstrap starting.
I20260809 23:23:18.912992 21167 tablet_service.cc:1467] Processing CreateTablet for tablet 5bae39d22304487182d31daf0c36500f (DEFAULT_TABLE table=test-table [id=b9ab56cf8fb04d1086f57d77ef7f117b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:18.913302 21167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bae39d22304487182d31daf0c36500f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:18.913342 21404 tablet_bootstrap.cc:654] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:18.913750 21405 tablet_bootstrap.cc:492] T 5bae39d22304487182d31daf0c36500f P df541f6b32924e4d95f2e7e9df65f890: Bootstrap starting.
I20260809 23:23:18.913937 21404 log.cc:824] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:18.914402 21405 tablet_bootstrap.cc:654] T 5bae39d22304487182d31daf0c36500f P df541f6b32924e4d95f2e7e9df65f890: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:18.914698 21404 tablet_bootstrap.cc:492] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b: No bootstrap required, opened a new log
I20260809 23:23:18.914767 21404 ts_tablet_manager.cc:1397] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:23:18.914949 21405 log.cc:824] T 5bae39d22304487182d31daf0c36500f P df541f6b32924e4d95f2e7e9df65f890: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:18.915555 21405 tablet_bootstrap.cc:492] T 5bae39d22304487182d31daf0c36500f P df541f6b32924e4d95f2e7e9df65f890: No bootstrap required, opened a new log
I20260809 23:23:18.915630 21405 ts_tablet_manager.cc:1397] T 5bae39d22304487182d31daf0c36500f P df541f6b32924e4d95f2e7e9df65f890: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 23:23:18.916365 21411 tablet_bootstrap.cc:492] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7: Bootstrap starting.
I20260809 23:23:18.916545 21404 raft_consensus.cc:348] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692cc200ceb34840a729f65c1c6bd0a7" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 45429 } } peers { permanent_uuid: "354e77d7fd014201be18b6b6e2ae472b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 35927 } } peers { permanent_uuid: "df541f6b32924e4d95f2e7e9df65f890" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37603 } }
I20260809 23:23:18.916688 21404 raft_consensus.cc:374] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:18.916728 21404 raft_consensus.cc:729] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 354e77d7fd014201be18b6b6e2ae472b, State: Initialized, Role: FOLLOWER
I20260809 23:23:18.916857 21404 consensus_queue.cc:260] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692cc200ceb34840a729f65c1c6bd0a7" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 45429 } } peers { permanent_uuid: "354e77d7fd014201be18b6b6e2ae472b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 35927 } } peers { permanent_uuid: "df541f6b32924e4d95f2e7e9df65f890" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37603 } }
I20260809 23:23:18.916970 21411 tablet_bootstrap.cc:654] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:18.917105 21404 ts_tablet_manager.cc:1428] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 23:23:18.917233 21387 heartbeater.cc:503] Master 127.1.235.190:43761 was elected leader, sending a full tablet report...
I20260809 23:23:18.917776 21411 log.cc:824] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:18.917737 21405 raft_consensus.cc:348] T 5bae39d22304487182d31daf0c36500f P df541f6b32924e4d95f2e7e9df65f890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692cc200ceb34840a729f65c1c6bd0a7" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 45429 } } peers { permanent_uuid: "354e77d7fd014201be18b6b6e2ae472b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 35927 } } peers { permanent_uuid: "df541f6b32924e4d95f2e7e9df65f890" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37603 } }
I20260809 23:23:18.917936 21405 raft_consensus.cc:374] T 5bae39d22304487182d31daf0c36500f P df541f6b32924e4d95f2e7e9df65f890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:18.917982 21405 raft_consensus.cc:729] T 5bae39d22304487182d31daf0c36500f P df541f6b32924e4d95f2e7e9df65f890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df541f6b32924e4d95f2e7e9df65f890, State: Initialized, Role: FOLLOWER
I20260809 23:23:18.918100 21405 consensus_queue.cc:260] T 5bae39d22304487182d31daf0c36500f P df541f6b32924e4d95f2e7e9df65f890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692cc200ceb34840a729f65c1c6bd0a7" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 45429 } } peers { permanent_uuid: "354e77d7fd014201be18b6b6e2ae472b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 35927 } } peers { permanent_uuid: "df541f6b32924e4d95f2e7e9df65f890" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37603 } }
I20260809 23:23:18.918417 21090 heartbeater.cc:503] Master 127.1.235.190:43761 was elected leader, sending a full tablet report...
I20260809 23:23:18.918429 21405 ts_tablet_manager.cc:1428] T 5bae39d22304487182d31daf0c36500f P df541f6b32924e4d95f2e7e9df65f890: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260809 23:23:18.918603 21411 tablet_bootstrap.cc:492] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7: No bootstrap required, opened a new log
I20260809 23:23:18.918651 21411 ts_tablet_manager.cc:1397] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 23:23:18.920059 21411 raft_consensus.cc:348] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692cc200ceb34840a729f65c1c6bd0a7" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 45429 } } peers { permanent_uuid: "354e77d7fd014201be18b6b6e2ae472b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 35927 } } peers { permanent_uuid: "df541f6b32924e4d95f2e7e9df65f890" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37603 } }
I20260809 23:23:18.920181 21411 raft_consensus.cc:374] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:18.920200 21411 raft_consensus.cc:729] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 692cc200ceb34840a729f65c1c6bd0a7, State: Initialized, Role: FOLLOWER
I20260809 23:23:18.920264 21411 consensus_queue.cc:260] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692cc200ceb34840a729f65c1c6bd0a7" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 45429 } } peers { permanent_uuid: "354e77d7fd014201be18b6b6e2ae472b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 35927 } } peers { permanent_uuid: "df541f6b32924e4d95f2e7e9df65f890" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37603 } }
I20260809 23:23:18.920460 21411 ts_tablet_manager.cc:1428] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 23:23:18.920532 21238 heartbeater.cc:503] Master 127.1.235.190:43761 was elected leader, sending a full tablet report...
W20260809 23:23:18.986954 21239 tablet.cc:2369] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:23:19.053879 21417 raft_consensus.cc:482] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:23:19.054030 21417 raft_consensus.cc:504] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692cc200ceb34840a729f65c1c6bd0a7" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 45429 } } peers { permanent_uuid: "354e77d7fd014201be18b6b6e2ae472b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 35927 } } peers { permanent_uuid: "df541f6b32924e4d95f2e7e9df65f890" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37603 } }
I20260809 23:23:19.054378 21417 leader_election.cc:288] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 354e77d7fd014201be18b6b6e2ae472b (127.1.235.131:35927), df541f6b32924e4d95f2e7e9df65f890 (127.1.235.129:37603)
I20260809 23:23:19.057262 21240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.054550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:35927 (local address 127.1.235.130:39523)
0809 23:23:19.054626 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:19.054655 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:19.054711 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:19.054858 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:19.054859 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:19.054861 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:19.054989 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.054991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.055723 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.055724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.056483 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.056485 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.057037 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.057039 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.057110 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.057115 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 23:23:19.057165 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 23:23:19.057205 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 23:23:19.057272 21402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.054619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:39523 (local address 127.1.235.131:35927)
0809 23:23:19.054686 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:19.054688 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:19.054697 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:23:19.054777 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:19.054778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:19.054788 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:19.054841 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:19.055111 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.055644 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.056558 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.056970 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.057018 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.057024 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:19.057178 (+ 154us) server_negotiation.cc:299] Negotiation successful
0809 23:23:19.057205 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 23:23:19.057438 21418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.054666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:37603 (local address 127.1.235.130:40169)
0809 23:23:19.054847 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:19.054856 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:19.054935 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:19.055111 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:19.055112 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:19.055114 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:19.055182 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.055184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.055829 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.055829 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.056655 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.056657 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.057187 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.057188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.057249 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.057253 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:23:19.057304 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 23:23:19.057340 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":102,"threads_started":1}
I20260809 23:23:19.057442 21403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.054727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:40169 (local address 127.1.235.129:37603)
0809 23:23:19.054768 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:19.054770 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:19.054954 (+ 184us) server_negotiation.cc:407] Connection header received
0809 23:23:19.055003 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:19.055004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:19.055015 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:19.055068 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:19.055258 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.055747 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.056734 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.057109 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.057174 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.057181 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:19.057323 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 23:23:19.057365 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 23:23:19.057657 21337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bae39d22304487182d31daf0c36500f" candidate_uuid: "692cc200ceb34840a729f65c1c6bd0a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354e77d7fd014201be18b6b6e2ae472b" is_pre_election: true
I20260809 23:23:19.057808 21337 raft_consensus.cc:2454] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 692cc200ceb34840a729f65c1c6bd0a7 in term 0.
I20260809 23:23:19.057968 21041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bae39d22304487182d31daf0c36500f" candidate_uuid: "692cc200ceb34840a729f65c1c6bd0a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df541f6b32924e4d95f2e7e9df65f890" is_pre_election: true
I20260809 23:23:19.058094 21041 raft_consensus.cc:2454] T 5bae39d22304487182d31daf0c36500f P df541f6b32924e4d95f2e7e9df65f890 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 692cc200ceb34840a729f65c1c6bd0a7 in term 0.
I20260809 23:23:19.058291 21115 leader_election.cc:302] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 692cc200ceb34840a729f65c1c6bd0a7, df541f6b32924e4d95f2e7e9df65f890; no voters:
I20260809 23:23:19.058429 21417 raft_consensus.cc:2781] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:23:19.058512 21417 raft_consensus.cc:482] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:23:19.058545 21417 raft_consensus.cc:3037] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:19.059226 21417 raft_consensus.cc:504] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692cc200ceb34840a729f65c1c6bd0a7" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 45429 } } peers { permanent_uuid: "354e77d7fd014201be18b6b6e2ae472b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 35927 } } peers { permanent_uuid: "df541f6b32924e4d95f2e7e9df65f890" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37603 } }
I20260809 23:23:19.059358 21417 leader_election.cc:288] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [CANDIDATE]: Term 1 election: Requested vote from peers 354e77d7fd014201be18b6b6e2ae472b (127.1.235.131:35927), df541f6b32924e4d95f2e7e9df65f890 (127.1.235.129:37603)
I20260809 23:23:19.059562 21337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bae39d22304487182d31daf0c36500f" candidate_uuid: "692cc200ceb34840a729f65c1c6bd0a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "354e77d7fd014201be18b6b6e2ae472b"
I20260809 23:23:19.059562 21041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bae39d22304487182d31daf0c36500f" candidate_uuid: "692cc200ceb34840a729f65c1c6bd0a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df541f6b32924e4d95f2e7e9df65f890"
I20260809 23:23:19.059634 21337 raft_consensus.cc:3037] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:19.059635 21041 raft_consensus.cc:3037] T 5bae39d22304487182d31daf0c36500f P df541f6b32924e4d95f2e7e9df65f890 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:19.060449 21041 raft_consensus.cc:2454] T 5bae39d22304487182d31daf0c36500f P df541f6b32924e4d95f2e7e9df65f890 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 692cc200ceb34840a729f65c1c6bd0a7 in term 1.
I20260809 23:23:19.060457 21337 raft_consensus.cc:2454] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 692cc200ceb34840a729f65c1c6bd0a7 in term 1.
I20260809 23:23:19.060614 21115 leader_election.cc:302] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 692cc200ceb34840a729f65c1c6bd0a7, df541f6b32924e4d95f2e7e9df65f890; no voters:
I20260809 23:23:19.060707 21417 raft_consensus.cc:2781] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:19.060827 21417 raft_consensus.cc:686] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [term 1 LEADER]: Becoming Leader. State: Replica: 692cc200ceb34840a729f65c1c6bd0a7, State: Running, Role: LEADER
I20260809 23:23:19.060925 21417 consensus_queue.cc:237] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692cc200ceb34840a729f65c1c6bd0a7" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 45429 } } peers { permanent_uuid: "354e77d7fd014201be18b6b6e2ae472b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 35927 } } peers { permanent_uuid: "df541f6b32924e4d95f2e7e9df65f890" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37603 } }
I20260809 23:23:19.061677 20877 catalog_manager.cc:5495] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 692cc200ceb34840a729f65c1c6bd0a7 (127.1.235.130). New cstate: current_term: 1 leader_uuid: "692cc200ceb34840a729f65c1c6bd0a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "692cc200ceb34840a729f65c1c6bd0a7" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 45429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "354e77d7fd014201be18b6b6e2ae472b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 35927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df541f6b32924e4d95f2e7e9df65f890" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37603 } health_report { overall_health: UNKNOWN } } }
W20260809 23:23:19.067924 21092 tablet.cc:2369] T 5bae39d22304487182d31daf0c36500f P df541f6b32924e4d95f2e7e9df65f890: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:23:19.087559 21400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.085476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50632 (local address 127.1.235.130:45429)
0809 23:23:19.085526 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:19.085527 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:19.085534 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:23:19.085586 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:19.085586 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:19.085599 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:19.085648 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:23:19.085755 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.086180 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.086919 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.087120 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.087175 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.087302 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:23:19.087382 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:23:19.087436 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:19.087468 (+ 32us) server_negotiation.cc:299] Negotiation successful
0809 23:23:19.087483 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 23:23:19.089191 21337 raft_consensus.cc:1261] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b [term 1 FOLLOWER]: Refusing update from remote peer 692cc200ceb34840a729f65c1c6bd0a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:23:19.089210 21041 raft_consensus.cc:1261] T 5bae39d22304487182d31daf0c36500f P df541f6b32924e4d95f2e7e9df65f890 [term 1 FOLLOWER]: Refusing update from remote peer 692cc200ceb34840a729f65c1c6bd0a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:23:19.089502 21420 consensus_queue.cc:1035] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "354e77d7fd014201be18b6b6e2ae472b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 35927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:23:19.089600 21417 consensus_queue.cc:1035] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df541f6b32924e4d95f2e7e9df65f890" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 37603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:23:19.091648 21423 mvcc.cc:205] Tried to move back new op lower bound from 7316757705066741760 to 7316757704954073088. Current Snapshot: MvccSnapshot[applied={T|T < 7316757705066741760}]
I20260809 23:23:19.092397 21425 mvcc.cc:205] Tried to move back new op lower bound from 7316757705066741760 to 7316757704954073088. Current Snapshot: MvccSnapshot[applied={T|T < 7316757705066741760}]
I20260809 23:23:19.094585 20876 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:23:19.094684 20876 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:23:19.095440 20876 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fedd1e99e67b427ea8b6b82604fade2c: Sending DeleteTablet for 3 replicas of tablet 5bae39d22304487182d31daf0c36500f
I20260809 23:23:19.095758 21167 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bae39d22304487182d31daf0c36500f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:19 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:50622
I20260809 23:23:19.095845 21315 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bae39d22304487182d31daf0c36500f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:19 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:33284
I20260809 23:23:19.095847 21020 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bae39d22304487182d31daf0c36500f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:19 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:59876
I20260809 23:23:19.096031 21434 tablet_replica.cc:330] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7: stopping tablet replica
I20260809 23:23:19.096129 21434 raft_consensus.cc:2229] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:23:19.096215 21434 raft_consensus.cc:2258] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:23:19.096206 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 20949
I20260809 23:23:19.096263 21435 tablet_replica.cc:330] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b: stopping tablet replica
I20260809 23:23:19.096449 21435 raft_consensus.cc:2229] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:23:19.096536 21435 raft_consensus.cc:2258] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:23:19.097476 21434 ts_tablet_manager.cc:1905] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:23:19.098992 21434 ts_tablet_manager.cc:1918] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:23:19.099063 21434 log.cc:1196] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/5bae39d22304487182d31daf0c36500f
I20260809 23:23:19.099332 21434 ts_tablet_manager.cc:1939] T 5bae39d22304487182d31daf0c36500f P 692cc200ceb34840a729f65c1c6bd0a7: Deleting consensus metadata
I20260809 23:23:19.099779 21435 ts_tablet_manager.cc:1905] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:23:19.099915 20861 catalog_manager.cc:4841] TS 692cc200ceb34840a729f65c1c6bd0a7 (127.1.235.130:45429): tablet 5bae39d22304487182d31daf0c36500f (table test-table [id=b9ab56cf8fb04d1086f57d77ef7f117b]) successfully deleted
I20260809 23:23:19.101227 21435 ts_tablet_manager.cc:1918] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:23:19.101295 21435 log.cc:1196] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/5bae39d22304487182d31daf0c36500f
I20260809 23:23:19.101549 21435 ts_tablet_manager.cc:1939] T 5bae39d22304487182d31daf0c36500f P 354e77d7fd014201be18b6b6e2ae472b: Deleting consensus metadata
I20260809 23:23:19.101917 20859 catalog_manager.cc:4841] TS 354e77d7fd014201be18b6b6e2ae472b (127.1.235.131:35927): tablet 5bae39d22304487182d31daf0c36500f (table test-table [id=b9ab56cf8fb04d1086f57d77ef7f117b]) successfully deleted
W20260809 23:23:19.104324 20859 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.235.129:37603 (error 108)
I20260809 23:23:19.104803 21401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.104647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:37603 (local address 127.0.0.1:59878)
0809 23:23:19.104726 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:19.104765 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.129:37603: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 23:23:19.104945 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 21096
W20260809 23:23:19.104956 20859 catalog_manager.cc:4584] TS df541f6b32924e4d95f2e7e9df65f890 (127.1.235.129:37603): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5bae39d22304487182d31daf0c36500f: Network error: Client connection negotiation failed: client connection to 127.1.235.129:37603: connect: Connection refused (error 111)
I20260809 23:23:19.118038 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 21243
I20260809 23:23:19.123638 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 20842
2026-08-09T23:23:19Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2025 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T23:23:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:19Z Disabled control of system clock
I20260809 23:23:19.150811 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:37719
--webserver_interface=127.1.235.190
--webserver_port=0
--builtin_ntp_servers=127.1.235.148:40453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:37719
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 23:23:19.224852 21442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:19.225032 21442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:19.225050 21442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:19.226080 21442 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:19.226117 21442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:19.226128 21442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:19.226156 21442 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:19.226182 21442 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:19.227363 21442 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:40453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:37719
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:37719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:19.227610 21442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:19.227859 21442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:19.232173 21448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:19.232236 21449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:19.232271 21442 server_base.cc:1034] running on GCE node
W20260809 23:23:19.232220 21451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:19.232671 21442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:19.233013 21442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:19.234177 21442 hybrid_clock.cc:648] HybridClock initialized: now 1786317799234171 us; error 35 us; skew 500 ppm
I20260809 23:23:19.235291 21442 webserver.cc:460] Webserver started at http://127.1.235.190:38799/ using document root <none> and password file <none>
I20260809 23:23:19.235510 21442 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:19.235584 21442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:19.235716 21442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:19.236573 21442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "9c20058fc4d648ccb2a498eda9f6bd78"
format_stamp: "Formatted at 2026-08-09 23:23:19 on dist-test-slave-6nmv"
server_key: "c0074ccaccac9a6e51fe6c97d65efbb8"
server_key_iv: "ecd9c773153a8480ef466d934fc22e04"
server_key_version: "encryptionkey@0"
I20260809 23:23:19.236883 21442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "9c20058fc4d648ccb2a498eda9f6bd78"
format_stamp: "Formatted at 2026-08-09 23:23:19 on dist-test-slave-6nmv"
server_key: "c0074ccaccac9a6e51fe6c97d65efbb8"
server_key_iv: "ecd9c773153a8480ef466d934fc22e04"
server_key_version: "encryptionkey@0"
I20260809 23:23:19.238063 21442 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 23:23:19.238711 21458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:19.238873 21442 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:19.238974 21442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "9c20058fc4d648ccb2a498eda9f6bd78"
format_stamp: "Formatted at 2026-08-09 23:23:19 on dist-test-slave-6nmv"
server_key: "c0074ccaccac9a6e51fe6c97d65efbb8"
server_key_iv: "ecd9c773153a8480ef466d934fc22e04"
server_key_version: "encryptionkey@0"
I20260809 23:23:19.239044 21442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:19.253161 21442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:19.253445 21442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:19.253604 21442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:19.257562 21442 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:37719
I20260809 23:23:19.257589 21516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:37719 every 8 connection(s)
I20260809 23:23:19.257931 21442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:19.258737 21518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:19.260722 21518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78: Bootstrap starting.
I20260809 23:23:19.261266 21518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:19.261539 21518 log.cc:824] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:19.262210 21518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78: No bootstrap required, opened a new log
I20260809 23:23:19.263916 21518 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c20058fc4d648ccb2a498eda9f6bd78" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37719 } }
I20260809 23:23:19.264053 21518 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:19.264086 21518 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c20058fc4d648ccb2a498eda9f6bd78, State: Initialized, Role: FOLLOWER
I20260809 23:23:19.264230 21518 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c20058fc4d648ccb2a498eda9f6bd78" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37719 } }
I20260809 23:23:19.264285 21518 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:19.264304 21518 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:19.264369 21518 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:19.264829 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 21442
I20260809 23:23:19.264952 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:19.264966 21518 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c20058fc4d648ccb2a498eda9f6bd78" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37719 } }
I20260809 23:23:19.265056 21518 leader_election.cc:302] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c20058fc4d648ccb2a498eda9f6bd78; no voters:
I20260809 23:23:19.265172 1966 external_mini_cluster.cc:1428] Setting key ea2d66e0e686b0447bd446bdfc74d192
I20260809 23:23:19.265250 21518 leader_election.cc:288] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:19.265314 21522 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:19.265484 21518 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:19.265596 21522 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [term 1 LEADER]: Becoming Leader. State: Replica: 9c20058fc4d648ccb2a498eda9f6bd78, State: Running, Role: LEADER
I20260809 23:23:19.265760 21522 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c20058fc4d648ccb2a498eda9f6bd78" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37719 } }
I20260809 23:23:19.266258 21523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c20058fc4d648ccb2a498eda9f6bd78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c20058fc4d648ccb2a498eda9f6bd78" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37719 } } }
I20260809 23:23:19.266336 21523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:19.266705 21524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c20058fc4d648ccb2a498eda9f6bd78. Latest consensus state: current_term: 1 leader_uuid: "9c20058fc4d648ccb2a498eda9f6bd78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c20058fc4d648ccb2a498eda9f6bd78" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 37719 } } }
I20260809 23:23:19.266796 21524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78 [sys.catalog]: This master's current role is: LEADER
W20260809 23:23:19.267243 21542 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 23:23:19.267302 21542 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:23:19.267344 21533 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:19.267475 21533 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:19.268827 21533 catalog_manager.cc:1347] Generated new cluster ID: 822113ea0de24a1aa4d5f0adef70429d
I20260809 23:23:19.268877 21533 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:19.271564 21526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.265651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51432 (local address 127.1.235.190:37719)
0809 23:23:19.265932 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:19.265939 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:19.266285 (+ 346us) server_negotiation.cc:407] Connection header received
0809 23:23:19.266497 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:19.266504 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:19.266570 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:19.266675 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:19.267143 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.268305 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.269263 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.269858 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.269963 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.270847 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:19.270851 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:19.270851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:19.271075 (+ 224us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:19.271117 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:19.271131 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:19.271207 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:19.271277 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 23:23:19.271355 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":63,"threads_started":1}
I20260809 23:23:19.277627 21533 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:19.278239 21533 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:19.283748 21533 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78: Generated new TSK 0
I20260809 23:23:19.283898 21533 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:19.287384 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:37719
--builtin_ntp_servers=127.1.235.148:40453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 23:23:19.362049 21548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:19.362246 21548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:19.362279 21548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:19.363409 21548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:19.363447 21548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:19.363472 21548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:23:19.364836 21548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:40453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:37719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:19.365038 21548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:19.365316 21548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:19.370141 21554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:19.370287 21553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:19.370343 21556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:19.370303 21548 server_base.cc:1034] running on GCE node
I20260809 23:23:19.370558 21548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:19.370744 21548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:19.371901 21548 hybrid_clock.cc:648] HybridClock initialized: now 1786317799371879 us; error 34 us; skew 500 ppm
I20260809 23:23:19.373234 21548 webserver.cc:460] Webserver started at http://127.1.235.129:39495/ using document root <none> and password file <none>
I20260809 23:23:19.373479 21548 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:19.373524 21548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:19.373667 21548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:19.374692 21548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "21e877ebfa434500bb8be6e1aa4eb2a0"
format_stamp: "Formatted at 2026-08-09 23:23:19 on dist-test-slave-6nmv"
server_key: "32ac3ef8a3f8ea68e05edb1c406c888b"
server_key_iv: "f5c25903777d3c067d299fe6f2968e31"
server_key_version: "encryptionkey@0"
I20260809 23:23:19.375066 21548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "21e877ebfa434500bb8be6e1aa4eb2a0"
format_stamp: "Formatted at 2026-08-09 23:23:19 on dist-test-slave-6nmv"
server_key: "32ac3ef8a3f8ea68e05edb1c406c888b"
server_key_iv: "f5c25903777d3c067d299fe6f2968e31"
server_key_version: "encryptionkey@0"
I20260809 23:23:19.376338 21548 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:23:19.377043 21563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:19.377185 21548 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:19.377259 21548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "21e877ebfa434500bb8be6e1aa4eb2a0"
format_stamp: "Formatted at 2026-08-09 23:23:19 on dist-test-slave-6nmv"
server_key: "32ac3ef8a3f8ea68e05edb1c406c888b"
server_key_iv: "f5c25903777d3c067d299fe6f2968e31"
server_key_version: "encryptionkey@0"
I20260809 23:23:19.377319 21548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:19.391186 21548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:19.391433 21548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:19.391562 21548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:19.391796 21548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:19.392094 21548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:19.392124 21548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:19.392171 21548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:19.392194 21548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:19.397745 21548 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:38063
I20260809 23:23:19.397825 21688 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:38063 every 8 connection(s)
I20260809 23:23:19.398097 21548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:23:19.402916 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 21548
I20260809 23:23:19.403026 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:23:19.403246 1966 external_mini_cluster.cc:1428] Setting key 188614d289d2c042ca74f1366a46a2a1
I20260809 23:23:19.403251 21526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.398812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:58383 (local address 127.1.235.190:37719)
0809 23:23:19.398871 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:19.398872 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:19.399091 (+ 219us) server_negotiation.cc:407] Connection header received
0809 23:23:19.399557 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:19.399558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:19.399571 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:19.399616 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:19.400234 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.400668 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.401854 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.402050 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.402133 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.402910 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:19.402911 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:19.402912 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:19.402917 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:19.402935 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:19.402940 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:19.403027 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:19.403169 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 23:23:19.403195 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 23:23:19.403467 21691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.398804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:37719 (local address 127.1.235.129:58383)
0809 23:23:19.398990 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:19.399018 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:19.399453 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:19.399677 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:19.399680 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:19.399689 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:19.400119 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.400123 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.400752 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.400753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.401761 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.401764 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.402141 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.402142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.402264 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.402715 (+ 451us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:23:19.402715 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:19.402751 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:23:19.402776 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:19.403029 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:19.403034 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:19.403037 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:23:19.403146 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 23:23:19.403252 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":71,"threads_started":1}
I20260809 23:23:19.404274 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:37719
--builtin_ntp_servers=127.1.235.148:40453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 23:23:19.405632 21689 heartbeater.cc:347] Connected to a master server at 127.1.235.190:37719
I20260809 23:23:19.405727 21689 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:19.405912 21689 heartbeater.cc:511] Master 127.1.235.190:37719 requested a full tablet report, sending...
I20260809 23:23:19.406359 21476 ts_manager.cc:194] Registered new tserver with Master: 21e877ebfa434500bb8be6e1aa4eb2a0 (127.1.235.129:38063)
I20260809 23:23:19.407105 21476 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.235.129:58383
W20260809 23:23:19.479079 21692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:19.479254 21692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:19.479274 21692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:19.480362 21692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:19.480405 21692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:19.480429 21692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:23:19.481633 21692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:40453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:37719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:19.481890 21692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:19.482146 21692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:19.486892 21700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:19.486940 21697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:19.486915 21698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:19.487015 21692 server_base.cc:1034] running on GCE node
I20260809 23:23:19.487247 21692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:19.487519 21692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:19.488683 21692 hybrid_clock.cc:648] HybridClock initialized: now 1786317799488673 us; error 27 us; skew 500 ppm
I20260809 23:23:19.489858 21692 webserver.cc:460] Webserver started at http://127.1.235.130:35299/ using document root <none> and password file <none>
I20260809 23:23:19.490082 21692 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:19.490124 21692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:19.490274 21692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:19.491220 21692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "48b14e0805db4eecaf1b392eb9d92232"
format_stamp: "Formatted at 2026-08-09 23:23:19 on dist-test-slave-6nmv"
server_key: "2d4ee16568756252c638e8afadadd7c9"
server_key_iv: "349b1e36635bcaac048334655a95d883"
server_key_version: "encryptionkey@0"
I20260809 23:23:19.491575 21692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "48b14e0805db4eecaf1b392eb9d92232"
format_stamp: "Formatted at 2026-08-09 23:23:19 on dist-test-slave-6nmv"
server_key: "2d4ee16568756252c638e8afadadd7c9"
server_key_iv: "349b1e36635bcaac048334655a95d883"
server_key_version: "encryptionkey@0"
I20260809 23:23:19.492970 21692 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:23:19.493731 21706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:19.493916 21692 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:23:19.494055 21692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "48b14e0805db4eecaf1b392eb9d92232"
format_stamp: "Formatted at 2026-08-09 23:23:19 on dist-test-slave-6nmv"
server_key: "2d4ee16568756252c638e8afadadd7c9"
server_key_iv: "349b1e36635bcaac048334655a95d883"
server_key_version: "encryptionkey@0"
I20260809 23:23:19.494123 21692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:19.504071 21692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:19.504344 21692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:19.504487 21692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:19.504683 21692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:19.504959 21692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:19.505012 21692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:19.505049 21692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:19.505075 21692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:19.510787 21692 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:35409
I20260809 23:23:19.510824 21833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:35409 every 8 connection(s)
I20260809 23:23:19.511108 21692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:23:19.515966 21526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.511756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:37451 (local address 127.1.235.190:37719)
0809 23:23:19.511818 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:19.511820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:19.512040 (+ 220us) server_negotiation.cc:407] Connection header received
0809 23:23:19.512480 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:19.512481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:19.512502 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:19.512554 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:19.513181 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.513684 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.514648 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.514862 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.514935 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.515714 (+ 779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:19.515715 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:19.515716 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:19.515720 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:19.515735 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:19.515739 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:19.515780 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:19.515864 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 23:23:19.515894 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 23:23:19.516160 21836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.511738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:37719 (local address 127.1.235.130:37451)
0809 23:23:19.511933 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:19.511973 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:19.512374 (+ 401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:19.512610 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:19.512613 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:19.512622 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:19.513083 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.513087 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.513782 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.513784 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.514545 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.514547 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.514947 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.514948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.515068 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.515562 (+ 494us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:23:19.515563 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:19.515587 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:23:19.515606 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:19.515779 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:19.515784 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:19.515786 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:23:19.515865 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 23:23:19.515961 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":85,"threads_started":1}
I20260809 23:23:19.516598 21834 heartbeater.cc:347] Connected to a master server at 127.1.235.190:37719
I20260809 23:23:19.516665 21834 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:19.516834 21834 heartbeater.cc:511] Master 127.1.235.190:37719 requested a full tablet report, sending...
I20260809 23:23:19.517169 21476 ts_manager.cc:194] Registered new tserver with Master: 48b14e0805db4eecaf1b392eb9d92232 (127.1.235.130:35409)
I20260809 23:23:19.517467 21476 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.235.130:37451
I20260809 23:23:19.519095 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 21692
I20260809 23:23:19.519200 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:23:19.519376 1966 external_mini_cluster.cc:1428] Setting key 0764cb4f425f4878ec12c2858787fde3
I20260809 23:23:19.520282 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:37719
--builtin_ntp_servers=127.1.235.148:40453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 23:23:19.594309 21837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:19.594554 21837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:19.594579 21837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:19.595606 21837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:19.595641 21837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:19.595664 21837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:23:19.596913 21837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:40453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:37719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:19.597136 21837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:19.597410 21837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:19.602011 21847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:19.602039 21845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:19.602041 21844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:19.602247 21837 server_base.cc:1034] running on GCE node
I20260809 23:23:19.602409 21837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:19.602609 21837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:19.603739 21837 hybrid_clock.cc:648] HybridClock initialized: now 1786317799603731 us; error 26 us; skew 500 ppm
I20260809 23:23:19.605156 21837 webserver.cc:460] Webserver started at http://127.1.235.131:42567/ using document root <none> and password file <none>
I20260809 23:23:19.605414 21837 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:19.605458 21837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:19.605600 21837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:19.606562 21837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "e51ea7dfc10141e0955a1f7aae58bf83"
format_stamp: "Formatted at 2026-08-09 23:23:19 on dist-test-slave-6nmv"
server_key: "0c0326a05dad192c3dfd603883f90ca2"
server_key_iv: "c21dac06cc28308ea88529f6a8ce36e6"
server_key_version: "encryptionkey@0"
I20260809 23:23:19.607051 21837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "e51ea7dfc10141e0955a1f7aae58bf83"
format_stamp: "Formatted at 2026-08-09 23:23:19 on dist-test-slave-6nmv"
server_key: "0c0326a05dad192c3dfd603883f90ca2"
server_key_iv: "c21dac06cc28308ea88529f6a8ce36e6"
server_key_version: "encryptionkey@0"
I20260809 23:23:19.608345 21837 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:23:19.609004 21853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:19.609180 21837 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:19.609262 21837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "e51ea7dfc10141e0955a1f7aae58bf83"
format_stamp: "Formatted at 2026-08-09 23:23:19 on dist-test-slave-6nmv"
server_key: "0c0326a05dad192c3dfd603883f90ca2"
server_key_iv: "c21dac06cc28308ea88529f6a8ce36e6"
server_key_version: "encryptionkey@0"
I20260809 23:23:19.609331 21837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:19.634443 21837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:19.634714 21837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:19.634861 21837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:19.635071 21837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:19.635390 21837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:19.635442 21837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:19.635491 21837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:19.635521 21837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:19.641578 21837 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:37943
I20260809 23:23:19.641633 21984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:37943 every 8 connection(s)
I20260809 23:23:19.642006 21837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:23:19.645224 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 21837
I20260809 23:23:19.645321 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:23:19.645604 1966 external_mini_cluster.cc:1428] Setting key 26290c8a7787330617d74a12a9d32688
I20260809 23:23:19.647341 21526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.642673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:56863 (local address 127.1.235.190:37719)
0809 23:23:19.642736 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:19.642738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:19.643012 (+ 274us) server_negotiation.cc:407] Connection header received
0809 23:23:19.643478 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:19.643479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:19.643492 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:19.643542 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:19.644201 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.644721 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.645900 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.646185 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.646257 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.647123 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:19.647124 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:19.647124 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:19.647129 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:19.647142 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:19.647146 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:19.647191 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:19.647263 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 23:23:19.647285 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 23:23:19.647555 21987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.642690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:37719 (local address 127.1.235.131:56863)
0809 23:23:19.642859 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:19.642908 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:19.643377 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:19.643615 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:19.643618 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:19.643627 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:19.644118 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.644122 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.644802 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.644803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.645779 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.645783 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.646276 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.646277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.646426 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.646995 (+ 569us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:23:19.646996 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:19.647030 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:23:19.647050 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:19.647202 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:19.647206 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:19.647207 (+ 1us) client_negotiation.cc:769] Sending connection context
0809 23:23:19.647252 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 23:23:19.647321 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":75,"threads_started":1}
I20260809 23:23:19.648006 21985 heartbeater.cc:347] Connected to a master server at 127.1.235.190:37719
I20260809 23:23:19.648073 21985 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:19.648238 21985 heartbeater.cc:511] Master 127.1.235.190:37719 requested a full tablet report, sending...
I20260809 23:23:19.648598 21476 ts_manager.cc:194] Registered new tserver with Master: e51ea7dfc10141e0955a1f7aae58bf83 (127.1.235.131:37943)
I20260809 23:23:19.648936 21476 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.235.131:56863
I20260809 23:23:19.657397 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:23:19.661083 21526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.658750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51448 (local address 127.1.235.190:37719)
0809 23:23:19.658834 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:19.658836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:19.658870 (+ 34us) server_negotiation.cc:407] Connection header received
0809 23:23:19.658917 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:19.658918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:19.658924 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:19.658964 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:19.659094 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.659483 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.660117 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.660274 (+ 157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.660320 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.660870 (+ 550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:19.660871 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:19.660871 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:19.660875 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:19.660894 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:19.660898 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:19.660938 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:19.660983 (+ 45us) server_negotiation.cc:299] Negotiation successful
0809 23:23:19.661000 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 23:23:19.662426 21476 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51448:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:23:19.663861 21476 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:23:19.669737 21996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.666158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:37943 (local address 127.0.0.1:44172)
0809 23:23:19.666301 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:19.666310 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:19.666362 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:19.666925 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:19.666926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:19.666927 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:19.666953 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.666954 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.667696 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.667697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.668822 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.668825 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.669483 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.669484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.669551 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.669562 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 23:23:19.669629 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 23:23:19.669674 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"mutex_wait_us":3,"thread_start_us":80,"threads_started":1}
I20260809 23:23:19.669749 21998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.666625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44172 (local address 127.1.235.131:37943)
0809 23:23:19.666767 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:19.666771 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:19.666779 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:23:19.666812 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:19.666813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:19.666827 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:19.666929 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:19.667008 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.667616 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.668915 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.669400 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.669480 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.669562 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:19.669642 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 23:23:19.669674 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":84,"threads_started":1}
I20260809 23:23:19.669862 21994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.665987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:35409 (local address 127.0.0.1:43866)
0809 23:23:19.666228 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:19.666239 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:19.666291 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:19.666787 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:19.666788 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:19.666790 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:19.666825 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.666826 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.668002 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.668003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.668821 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.668823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.669634 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.669635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.669699 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.669703 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:23:19.669731 (+ 28us) client_negotiation.cc:240] Negotiation successful
0809 23:23:19.669767 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":92,"threads_started":1}
I20260809 23:23:19.669953 21993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.665967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:38063 (local address 127.0.0.1:53272)
0809 23:23:19.666061 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:19.666097 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:19.666154 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:19.666455 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:19.666458 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:19.666460 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:19.666541 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.666542 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.667989 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.667990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.668936 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.668938 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.669712 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.669713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.669761 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.669763 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:23:19.669789 (+ 26us) client_negotiation.cc:240] Negotiation successful
0809 23:23:19.669847 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73,"mutex_wait_us":1,"thread_start_us":54,"threads_started":1}
I20260809 23:23:19.670243 21997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.666426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43866 (local address 127.1.235.130:35409)
0809 23:23:19.666655 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:19.666659 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:19.666668 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:23:19.666704 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:19.666705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:19.666718 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:19.666787 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:19.666901 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.667902 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.668899 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.669539 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.670027 (+ 488us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.670108 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:19.670141 (+ 33us) server_negotiation.cc:299] Negotiation successful
0809 23:23:19.670176 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":102,"threads_started":1}
I20260809 23:23:19.670266 21995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.666086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53272 (local address 127.1.235.129:38063)
0809 23:23:19.666280 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:19.666285 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:19.666294 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:23:19.666334 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:19.666347 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:19.666361 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:19.666444 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:19.666839 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.667898 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.669003 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.669637 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.670062 (+ 425us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.670150 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:19.670168 (+ 18us) server_negotiation.cc:299] Negotiation successful
0809 23:23:19.670198 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":84,"threads_started":1}
I20260809 23:23:19.670503 21913 tablet_service.cc:1467] Processing CreateTablet for tablet a4228833d9f14f50b4956341493a4d04 (DEFAULT_TABLE table=test-table [id=d614ff2078a54bee80efff65ab705037]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:19.670853 21913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4228833d9f14f50b4956341493a4d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:19.670851 21616 tablet_service.cc:1467] Processing CreateTablet for tablet a4228833d9f14f50b4956341493a4d04 (DEFAULT_TABLE table=test-table [id=d614ff2078a54bee80efff65ab705037]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:19.671185 21616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4228833d9f14f50b4956341493a4d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:19.674264 22000 tablet_bootstrap.cc:492] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83: Bootstrap starting.
I20260809 23:23:19.674376 21761 tablet_service.cc:1467] Processing CreateTablet for tablet a4228833d9f14f50b4956341493a4d04 (DEFAULT_TABLE table=test-table [id=d614ff2078a54bee80efff65ab705037]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:19.674685 21761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4228833d9f14f50b4956341493a4d04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:19.674986 22000 tablet_bootstrap.cc:654] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:19.675290 22000 log.cc:824] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:19.675997 22000 tablet_bootstrap.cc:492] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83: No bootstrap required, opened a new log
I20260809 23:23:19.676064 22000 ts_tablet_manager.cc:1397] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:23:19.677846 22003 tablet_bootstrap.cc:492] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232: Bootstrap starting.
I20260809 23:23:19.677930 22001 tablet_bootstrap.cc:492] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0: Bootstrap starting.
I20260809 23:23:19.678355 22003 tablet_bootstrap.cc:654] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:19.678498 22001 tablet_bootstrap.cc:654] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:19.678486 22000 raft_consensus.cc:348] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21e877ebfa434500bb8be6e1aa4eb2a0" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 38063 } } peers { permanent_uuid: "48b14e0805db4eecaf1b392eb9d92232" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35409 } } peers { permanent_uuid: "e51ea7dfc10141e0955a1f7aae58bf83" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 37943 } }
I20260809 23:23:19.678648 22000 raft_consensus.cc:374] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:19.678691 22000 raft_consensus.cc:729] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51ea7dfc10141e0955a1f7aae58bf83, State: Initialized, Role: FOLLOWER
I20260809 23:23:19.678682 22003 log.cc:824] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:19.678785 22001 log.cc:824] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:19.678799 22000 consensus_queue.cc:260] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21e877ebfa434500bb8be6e1aa4eb2a0" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 38063 } } peers { permanent_uuid: "48b14e0805db4eecaf1b392eb9d92232" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35409 } } peers { permanent_uuid: "e51ea7dfc10141e0955a1f7aae58bf83" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 37943 } }
I20260809 23:23:19.679060 22000 ts_tablet_manager.cc:1428] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:23:19.679178 21985 heartbeater.cc:503] Master 127.1.235.190:37719 was elected leader, sending a full tablet report...
I20260809 23:23:19.679486 22001 tablet_bootstrap.cc:492] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0: No bootstrap required, opened a new log
I20260809 23:23:19.679553 22001 ts_tablet_manager.cc:1397] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 23:23:19.679661 22003 tablet_bootstrap.cc:492] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232: No bootstrap required, opened a new log
I20260809 23:23:19.679700 22003 ts_tablet_manager.cc:1397] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:23:19.681723 22001 raft_consensus.cc:348] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21e877ebfa434500bb8be6e1aa4eb2a0" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 38063 } } peers { permanent_uuid: "48b14e0805db4eecaf1b392eb9d92232" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35409 } } peers { permanent_uuid: "e51ea7dfc10141e0955a1f7aae58bf83" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 37943 } }
I20260809 23:23:19.681878 22001 raft_consensus.cc:374] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:19.681929 22001 raft_consensus.cc:729] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21e877ebfa434500bb8be6e1aa4eb2a0, State: Initialized, Role: FOLLOWER
I20260809 23:23:19.682034 22001 consensus_queue.cc:260] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21e877ebfa434500bb8be6e1aa4eb2a0" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 38063 } } peers { permanent_uuid: "48b14e0805db4eecaf1b392eb9d92232" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35409 } } peers { permanent_uuid: "e51ea7dfc10141e0955a1f7aae58bf83" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 37943 } }
I20260809 23:23:19.681982 22003 raft_consensus.cc:348] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21e877ebfa434500bb8be6e1aa4eb2a0" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 38063 } } peers { permanent_uuid: "48b14e0805db4eecaf1b392eb9d92232" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35409 } } peers { permanent_uuid: "e51ea7dfc10141e0955a1f7aae58bf83" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 37943 } }
I20260809 23:23:19.682113 22003 raft_consensus.cc:374] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:19.682173 22003 raft_consensus.cc:729] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48b14e0805db4eecaf1b392eb9d92232, State: Initialized, Role: FOLLOWER
I20260809 23:23:19.682262 22001 ts_tablet_manager.cc:1428] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260809 23:23:19.682286 22003 consensus_queue.cc:260] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21e877ebfa434500bb8be6e1aa4eb2a0" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 38063 } } peers { permanent_uuid: "48b14e0805db4eecaf1b392eb9d92232" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35409 } } peers { permanent_uuid: "e51ea7dfc10141e0955a1f7aae58bf83" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 37943 } }
I20260809 23:23:19.682332 21689 heartbeater.cc:503] Master 127.1.235.190:37719 was elected leader, sending a full tablet report...
I20260809 23:23:19.682520 22003 ts_tablet_manager.cc:1428] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:23:19.682561 21834 heartbeater.cc:503] Master 127.1.235.190:37719 was elected leader, sending a full tablet report...
W20260809 23:23:19.761682 21835 tablet.cc:2369] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:23:19.838624 22008 raft_consensus.cc:482] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:23:19.838739 22008 raft_consensus.cc:504] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21e877ebfa434500bb8be6e1aa4eb2a0" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 38063 } } peers { permanent_uuid: "48b14e0805db4eecaf1b392eb9d92232" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35409 } } peers { permanent_uuid: "e51ea7dfc10141e0955a1f7aae58bf83" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 37943 } }
I20260809 23:23:19.839102 22008 leader_election.cc:288] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48b14e0805db4eecaf1b392eb9d92232 (127.1.235.130:35409), e51ea7dfc10141e0955a1f7aae58bf83 (127.1.235.131:37943)
I20260809 23:23:19.841715 21691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.839292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:35409 (local address 127.1.235.129:51489)
0809 23:23:19.839351 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:19.839363 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:19.839423 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:19.839593 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:19.839594 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:19.839596 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:19.839672 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.839674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.840255 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.840256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.840956 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.840958 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.841464 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.841465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.841534 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.841536 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:23:19.841596 (+ 60us) client_negotiation.cc:240] Negotiation successful
0809 23:23:19.841634 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 23:23:19.841724 21997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.839424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:51489 (local address 127.1.235.130:35409)
0809 23:23:19.839480 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:19.839481 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:19.839488 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:23:19.839521 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:19.839521 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:19.839528 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:19.839590 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:19.839739 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.840167 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.841040 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.841364 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.841466 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.841474 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:19.841603 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 23:23:19.841636 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 23:23:19.842015 21998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.839396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:34665 (local address 127.1.235.131:37943)
0809 23:23:19.839445 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:19.839447 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:19.839656 (+ 209us) server_negotiation.cc:407] Connection header received
0809 23:23:19.839722 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:19.839723 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:19.839731 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:19.839805 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:19.839963 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.840355 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.841211 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.841584 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.841675 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.841682 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:19.841897 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 23:23:19.841938 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 23:23:19.842197 22010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.839293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:37943 (local address 127.1.235.129:34665)
0809 23:23:19.839576 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:19.839585 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:19.839662 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:19.839809 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:19.839809 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:19.839810 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:19.839873 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.839875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.840434 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.840435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.841137 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:19.841139 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.841714 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.841714 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:19.841777 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.841781 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:23:19.842087 (+ 306us) client_negotiation.cc:240] Negotiation successful
0809 23:23:19.842124 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":83,"thread_start_us":146,"threads_started":1}
I20260809 23:23:19.842171 21784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4228833d9f14f50b4956341493a4d04" candidate_uuid: "21e877ebfa434500bb8be6e1aa4eb2a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48b14e0805db4eecaf1b392eb9d92232" is_pre_election: true
I20260809 23:23:19.842310 21784 raft_consensus.cc:2454] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21e877ebfa434500bb8be6e1aa4eb2a0 in term 0.
I20260809 23:23:19.842600 21567 leader_election.cc:302] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21e877ebfa434500bb8be6e1aa4eb2a0, 48b14e0805db4eecaf1b392eb9d92232; no voters:
I20260809 23:23:19.842604 21935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4228833d9f14f50b4956341493a4d04" candidate_uuid: "21e877ebfa434500bb8be6e1aa4eb2a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51ea7dfc10141e0955a1f7aae58bf83" is_pre_election: true
I20260809 23:23:19.842727 21935 raft_consensus.cc:2454] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21e877ebfa434500bb8be6e1aa4eb2a0 in term 0.
I20260809 23:23:19.842746 22008 raft_consensus.cc:2781] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:23:19.842821 22008 raft_consensus.cc:482] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:23:19.842861 22008 raft_consensus.cc:3037] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:19.843607 22008 raft_consensus.cc:504] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21e877ebfa434500bb8be6e1aa4eb2a0" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 38063 } } peers { permanent_uuid: "48b14e0805db4eecaf1b392eb9d92232" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35409 } } peers { permanent_uuid: "e51ea7dfc10141e0955a1f7aae58bf83" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 37943 } }
I20260809 23:23:19.843739 22008 leader_election.cc:288] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [CANDIDATE]: Term 1 election: Requested vote from peers 48b14e0805db4eecaf1b392eb9d92232 (127.1.235.130:35409), e51ea7dfc10141e0955a1f7aae58bf83 (127.1.235.131:37943)
I20260809 23:23:19.843886 21935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4228833d9f14f50b4956341493a4d04" candidate_uuid: "21e877ebfa434500bb8be6e1aa4eb2a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51ea7dfc10141e0955a1f7aae58bf83"
I20260809 23:23:19.843967 21784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4228833d9f14f50b4956341493a4d04" candidate_uuid: "21e877ebfa434500bb8be6e1aa4eb2a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48b14e0805db4eecaf1b392eb9d92232"
I20260809 23:23:19.843967 21935 raft_consensus.cc:3037] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:19.844075 21784 raft_consensus.cc:3037] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:19.844730 21935 raft_consensus.cc:2454] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21e877ebfa434500bb8be6e1aa4eb2a0 in term 1.
I20260809 23:23:19.844885 21784 raft_consensus.cc:2454] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21e877ebfa434500bb8be6e1aa4eb2a0 in term 1.
I20260809 23:23:19.844935 21564 leader_election.cc:302] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21e877ebfa434500bb8be6e1aa4eb2a0, e51ea7dfc10141e0955a1f7aae58bf83; no voters:
I20260809 23:23:19.845012 22008 raft_consensus.cc:2781] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:19.845163 22008 raft_consensus.cc:686] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [term 1 LEADER]: Becoming Leader. State: Replica: 21e877ebfa434500bb8be6e1aa4eb2a0, State: Running, Role: LEADER
I20260809 23:23:19.845260 22008 consensus_queue.cc:237] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21e877ebfa434500bb8be6e1aa4eb2a0" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 38063 } } peers { permanent_uuid: "48b14e0805db4eecaf1b392eb9d92232" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35409 } } peers { permanent_uuid: "e51ea7dfc10141e0955a1f7aae58bf83" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 37943 } }
I20260809 23:23:19.846163 21476 catalog_manager.cc:5495] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21e877ebfa434500bb8be6e1aa4eb2a0 (127.1.235.129). New cstate: current_term: 1 leader_uuid: "21e877ebfa434500bb8be6e1aa4eb2a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21e877ebfa434500bb8be6e1aa4eb2a0" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48b14e0805db4eecaf1b392eb9d92232" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51ea7dfc10141e0955a1f7aae58bf83" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 37943 } health_report { overall_health: UNKNOWN } } }
W20260809 23:23:19.892541 21986 tablet.cc:2369] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:23:19.894009 21995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.891768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53276 (local address 127.1.235.129:38063)
0809 23:23:19.891826 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:19.891828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:19.891834 (+ 6us) server_negotiation.cc:407] Connection header received
0809 23:23:19.891862 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:19.891863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:19.891879 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:19.891946 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:23:19.892048 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.892528 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.893315 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:19.893497 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:19.893552 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:19.893680 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:23:19.893765 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:23:19.893840 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:19.893931 (+ 91us) server_negotiation.cc:299] Negotiation successful
0809 23:23:19.893947 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 23:23:19.895502 21935 raft_consensus.cc:1261] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83 [term 1 FOLLOWER]: Refusing update from remote peer 21e877ebfa434500bb8be6e1aa4eb2a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:23:19.895514 21784 raft_consensus.cc:1261] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232 [term 1 FOLLOWER]: Refusing update from remote peer 21e877ebfa434500bb8be6e1aa4eb2a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:23:19.895807 22008 consensus_queue.cc:1035] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48b14e0805db4eecaf1b392eb9d92232" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:23:19.895959 22011 consensus_queue.cc:1035] T a4228833d9f14f50b4956341493a4d04 P 21e877ebfa434500bb8be6e1aa4eb2a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51ea7dfc10141e0955a1f7aae58bf83" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 37943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:23:19.898136 22014 mvcc.cc:205] Tried to move back new op lower bound from 7316757708369649664 to 7316757708166946816. Current Snapshot: MvccSnapshot[applied={T|T < 7316757708369649664}]
I20260809 23:23:19.898546 22016 mvcc.cc:205] Tried to move back new op lower bound from 7316757708369649664 to 7316757708166946816. Current Snapshot: MvccSnapshot[applied={T|T < 7316757708369649664}]
I20260809 23:23:19.900357 21476 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:23:19.900449 21476 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51448:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:23:19.901199 21476 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c20058fc4d648ccb2a498eda9f6bd78: Sending DeleteTablet for 3 replicas of tablet a4228833d9f14f50b4956341493a4d04
I20260809 23:23:19.901515 21761 tablet_service.cc:1514] Processing DeleteTablet for tablet a4228833d9f14f50b4956341493a4d04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:19 UTC) from {username='slave'} at 127.0.0.1:43866
I20260809 23:23:19.901504 21616 tablet_service.cc:1514] Processing DeleteTablet for tablet a4228833d9f14f50b4956341493a4d04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:19 UTC) from {username='slave'} at 127.0.0.1:53272
I20260809 23:23:19.901566 21913 tablet_service.cc:1514] Processing DeleteTablet for tablet a4228833d9f14f50b4956341493a4d04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:19 UTC) from {username='slave'} at 127.0.0.1:44172
I20260809 23:23:19.901716 22026 tablet_replica.cc:330] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232: stopping tablet replica
I20260809 23:23:19.901798 22026 raft_consensus.cc:2229] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:23:19.901917 22026 raft_consensus.cc:2258] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:23:19.902067 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 21548
I20260809 23:23:19.907235 22027 tablet_replica.cc:330] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83: stopping tablet replica
I20260809 23:23:19.907346 22027 raft_consensus.cc:2229] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:23:19.907464 22027 raft_consensus.cc:2258] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:23:19.907641 22026 ts_tablet_manager.cc:1905] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:23:19.907832 22027 ts_tablet_manager.cc:1905] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:23:19.909072 22027 ts_tablet_manager.cc:1918] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:23:19.909086 22026 ts_tablet_manager.cc:1918] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:23:19.909153 22027 log.cc:1196] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/a4228833d9f14f50b4956341493a4d04
I20260809 23:23:19.909150 22026 log.cc:1196] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/a4228833d9f14f50b4956341493a4d04
I20260809 23:23:19.909386 22027 ts_tablet_manager.cc:1939] T a4228833d9f14f50b4956341493a4d04 P e51ea7dfc10141e0955a1f7aae58bf83: Deleting consensus metadata
I20260809 23:23:19.909418 22026 ts_tablet_manager.cc:1939] T a4228833d9f14f50b4956341493a4d04 P 48b14e0805db4eecaf1b392eb9d92232: Deleting consensus metadata
I20260809 23:23:19.909752 21460 catalog_manager.cc:4841] TS e51ea7dfc10141e0955a1f7aae58bf83 (127.1.235.131:37943): tablet a4228833d9f14f50b4956341493a4d04 (table test-table [id=d614ff2078a54bee80efff65ab705037]) successfully deleted
I20260809 23:23:19.909840 21463 catalog_manager.cc:4841] TS 48b14e0805db4eecaf1b392eb9d92232 (127.1.235.130:35409): tablet a4228833d9f14f50b4956341493a4d04 (table test-table [id=d614ff2078a54bee80efff65ab705037]) successfully deleted
W20260809 23:23:19.912516 21460 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.235.129:38063 (error 108)
I20260809 23:23:19.912714 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 21692
I20260809 23:23:19.914975 21993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:19.914828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:38063 (local address 127.0.0.1:53282)
0809 23:23:19.914889 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:19.914939 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.129:38063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 23:23:19.915104 21460 catalog_manager.cc:4584] TS 21e877ebfa434500bb8be6e1aa4eb2a0 (127.1.235.129:38063): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a4228833d9f14f50b4956341493a4d04: Network error: Client connection negotiation failed: client connection to 127.1.235.129:38063: connect: Connection refused (error 111)
I20260809 23:23:19.918759 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 21837
I20260809 23:23:19.924124 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 21442
2026-08-09T23:23:19Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (800 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:19 dist-test-slave-6nmv krb5kdc[22031](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:19 dist-test-slave-6nmv krb5kdc[22031](info): set up 2 sockets
Aug 09 23:23:19 dist-test-slave-6nmv krb5kdc[22031](info): commencing operation
krb5kdc: starting...
W20260809 23:23:20.956892 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.012s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:21 dist-test-slave-6nmv krb5kdc[22031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:23:21.064880 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:40113
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:43635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:40113
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:21.140441 22046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:21.140638 22046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:21.140674 22046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:21.141755 22046 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:21.141816 22046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:21.141863 22046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:21.141894 22046 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:21.141916 22046 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:21.143328 22046 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:43635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:40113
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:40113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:21.143600 22046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:21.143838 22046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:21.148340 22054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:21.148376 22052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:21.148438 22046 server_base.cc:1034] running on GCE node
W20260809 23:23:21.148376 22051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:21.148785 22046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:21.149088 22046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:21.150226 22046 hybrid_clock.cc:648] HybridClock initialized: now 1786317801150206 us; error 38 us; skew 500 ppm
Aug 09 23:23:21 dist-test-slave-6nmv krb5kdc[22031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317801, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:21.152652 22046 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:23:21.153139 22046 webserver.cc:460] Webserver started at http://127.1.235.190:38585/ using document root <none> and password file <none>
I20260809 23:23:21.153374 22046 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:21.153424 22046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:21.153556 22046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:21.154623 22046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "9dba6f0b9f9f4f9ca2fabdd4eaab51f4"
format_stamp: "Formatted at 2026-08-09 23:23:21 on dist-test-slave-6nmv"
server_key: "bfb407068930d2b221ae6b5756fa7807"
server_key_iv: "b94e84663e632095c0afc11bc32c6bf5"
server_key_version: "encryptionkey@0"
I20260809 23:23:21.154965 22046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "9dba6f0b9f9f4f9ca2fabdd4eaab51f4"
format_stamp: "Formatted at 2026-08-09 23:23:21 on dist-test-slave-6nmv"
server_key: "bfb407068930d2b221ae6b5756fa7807"
server_key_iv: "b94e84663e632095c0afc11bc32c6bf5"
server_key_version: "encryptionkey@0"
I20260809 23:23:21.156240 22046 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 23:23:21.156910 22061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:21.157115 22046 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:23:21.157204 22046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "9dba6f0b9f9f4f9ca2fabdd4eaab51f4"
format_stamp: "Formatted at 2026-08-09 23:23:21 on dist-test-slave-6nmv"
server_key: "bfb407068930d2b221ae6b5756fa7807"
server_key_iv: "b94e84663e632095c0afc11bc32c6bf5"
server_key_version: "encryptionkey@0"
I20260809 23:23:21.157281 22046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:21.182482 22046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:21.184684 22046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:21.184796 22046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:21.188886 22046 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:40113
I20260809 23:23:21.188943 22117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:40113 every 8 connection(s)
I20260809 23:23:21.189244 22046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:21.190084 22118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:21.192237 22118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4: Bootstrap starting.
I20260809 23:23:21.192799 22118 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:21.193109 22118 log.cc:824] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:21.193791 22118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4: No bootstrap required, opened a new log
I20260809 23:23:21.195237 22118 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dba6f0b9f9f4f9ca2fabdd4eaab51f4" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40113 } }
I20260809 23:23:21.195349 22118 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:21.195392 22118 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dba6f0b9f9f4f9ca2fabdd4eaab51f4, State: Initialized, Role: FOLLOWER
I20260809 23:23:21.195534 22118 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dba6f0b9f9f4f9ca2fabdd4eaab51f4" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40113 } }
I20260809 23:23:21.195590 22118 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:21.195626 22118 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:21.195668 22118 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:21.196125 22118 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dba6f0b9f9f4f9ca2fabdd4eaab51f4" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40113 } }
I20260809 23:23:21.196221 22118 leader_election.cc:302] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9dba6f0b9f9f4f9ca2fabdd4eaab51f4; no voters:
I20260809 23:23:21.196370 22118 leader_election.cc:288] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:21.196403 22121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:21.196584 22121 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [term 1 LEADER]: Becoming Leader. State: Replica: 9dba6f0b9f9f4f9ca2fabdd4eaab51f4, State: Running, Role: LEADER
I20260809 23:23:21.196642 22118 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:21.196657 22121 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dba6f0b9f9f4f9ca2fabdd4eaab51f4" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40113 } }
I20260809 23:23:21.197077 22123 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9dba6f0b9f9f4f9ca2fabdd4eaab51f4. Latest consensus state: current_term: 1 leader_uuid: "9dba6f0b9f9f4f9ca2fabdd4eaab51f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dba6f0b9f9f4f9ca2fabdd4eaab51f4" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40113 } } }
I20260809 23:23:21.197157 22123 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:21.197275 22122 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9dba6f0b9f9f4f9ca2fabdd4eaab51f4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dba6f0b9f9f4f9ca2fabdd4eaab51f4" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40113 } } }
I20260809 23:23:21.197363 22122 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4 [sys.catalog]: This master's current role is: LEADER
W20260809 23:23:21.198310 22138 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 23:23:21.198354 22138 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:23:21.198428 22130 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:21.198592 22130 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:21.199330 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 22046
I20260809 23:23:21.199450 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:21.199663 1966 external_mini_cluster.cc:1428] Setting key 959e2d2ca31af8980b84417d7cd0522d
I20260809 23:23:21.200181 22130 catalog_manager.cc:1347] Generated new cluster ID: be334705e14c40f794ce954ede48a96a
I20260809 23:23:21.200225 22130 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 23:23:21 dist-test-slave-6nmv krb5kdc[22031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317801, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:21.212349 22130 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:21.212450 22142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.200055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34476 (local address 127.1.235.190:40113)
0809 23:23:21.201964 (+ 1909us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:21.201972 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:21.202002 (+ 30us) server_negotiation.cc:407] Connection header received
0809 23:23:21.202097 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:21.202103 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:21.202156 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:21.202272 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:21.203064 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.204465 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.205495 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.206127 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.206236 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.208916 (+ 2680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:21.208920 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:21.208920 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:21.208931 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:21.210743 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:21.211119 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:21.211122 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:21.211122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:21.211229 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:21.211467 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:21.211468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:21.211468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:21.211782 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:21.211907 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:21.212055 (+ 148us) server_negotiation.cc:299] Negotiation successful
0809 23:23:21.212201 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1838,"thread_start_us":74,"threads_started":1}
I20260809 23:23:21.212986 22130 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:21.219149 22130 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4: Generated new TSK 0
I20260809 23:23:21.219287 22130 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:23:21.245879 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:40113
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:43635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:21.321369 22145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:21.321568 22145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:21.321602 22145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:21.322643 22145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:21.322708 22145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:21.322746 22145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:23:21.324138 22145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:43635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:40113
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:21.324401 22145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:21.324606 22145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:21.328908 22153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:21.328995 22150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:21.329095 22145 server_base.cc:1034] running on GCE node
W20260809 23:23:21.328892 22151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:21.329342 22145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:21.329566 22145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:21.330737 22145 hybrid_clock.cc:648] HybridClock initialized: now 1786317801330716 us; error 30 us; skew 500 ppm
Aug 09 23:23:21 dist-test-slave-6nmv krb5kdc[22031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317801, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:21.333316 22145 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:23:21.333766 22145 webserver.cc:460] Webserver started at http://127.1.235.129:45961/ using document root <none> and password file <none>
I20260809 23:23:21.334012 22145 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:21.334082 22145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:21.334246 22145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:21.335136 22145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "e59bc576741f403186b324584d236dbe"
format_stamp: "Formatted at 2026-08-09 23:23:21 on dist-test-slave-6nmv"
server_key: "1379b6e1a2db242cde3155fce34fe633"
server_key_iv: "65505e54e79f44060efd4d66c06de32b"
server_key_version: "encryptionkey@0"
I20260809 23:23:21.335460 22145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "e59bc576741f403186b324584d236dbe"
format_stamp: "Formatted at 2026-08-09 23:23:21 on dist-test-slave-6nmv"
server_key: "1379b6e1a2db242cde3155fce34fe633"
server_key_iv: "65505e54e79f44060efd4d66c06de32b"
server_key_version: "encryptionkey@0"
I20260809 23:23:21.336653 22145 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 23:23:21.337257 22160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:21.337414 22145 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:21.337499 22145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "e59bc576741f403186b324584d236dbe"
format_stamp: "Formatted at 2026-08-09 23:23:21 on dist-test-slave-6nmv"
server_key: "1379b6e1a2db242cde3155fce34fe633"
server_key_iv: "65505e54e79f44060efd4d66c06de32b"
server_key_version: "encryptionkey@0"
I20260809 23:23:21.337575 22145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:21.349028 22145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:21.350668 22145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:21.350808 22145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:21.351011 22145 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:21.351274 22145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:21.351325 22145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:21.351361 22145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:21.351385 22145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:21.356895 22145 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:39065
I20260809 23:23:21.356945 22283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:39065 every 8 connection(s)
I20260809 23:23:21.357198 22145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:23:21.360203 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 22145
I20260809 23:23:21.360340 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:23:21.360536 1966 external_mini_cluster.cc:1428] Setting key 39539ccb88f10e06f41b7fd6c965cc19
Aug 09 23:23:21 dist-test-slave-6nmv krb5kdc[22031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317801, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:21.366225 22142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.357874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:53795 (local address 127.1.235.190:40113)
0809 23:23:21.357923 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:21.357925 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:21.358158 (+ 233us) server_negotiation.cc:407] Connection header received
0809 23:23:21.358617 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:21.358618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:21.358634 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:21.358714 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:21.359513 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.360111 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.361361 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.361645 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.361715 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.363653 (+ 1938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:21.363655 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:21.363655 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:21.363663 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:21.364929 (+ 1266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:21.365300 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:21.365302 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:21.365302 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:21.365360 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:21.365617 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:21.365618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:21.365618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:21.365720 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:21.365791 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:21.366061 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 23:23:21.366142 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:23:21.366366 22286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.357871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40113 (local address 127.1.235.129:53795)
0809 23:23:21.358045 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:21.358077 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:21.358516 (+ 439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:21.358768 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:21.358772 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:21.359239 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:21.359418 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:21.359422 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.360199 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.360199 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:21.361277 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:21.361280 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.361741 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.361742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:21.361866 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.362284 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:21.362290 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:21.363553 (+ 1263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:21.365025 (+ 1472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:21.365032 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:21.365034 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:21.365230 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:21.365429 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:21.365430 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:21.365430 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:21.365545 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:21.365783 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:21.365790 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:21.365937 (+ 147us) client_negotiation.cc:769] Sending connection context
0809 23:23:21.366038 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 23:23:21.366173 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":91,"threads_started":1}
I20260809 23:23:21.366832 22284 heartbeater.cc:347] Connected to a master server at 127.1.235.190:40113
I20260809 23:23:21.366937 22284 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:21.367110 22284 heartbeater.cc:511] Master 127.1.235.190:40113 requested a full tablet report, sending...
I20260809 23:23:21.367594 22080 ts_manager.cc:194] Registered new tserver with Master: e59bc576741f403186b324584d236dbe (127.1.235.129:39065)
I20260809 23:23:21.368458 22080 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:53795
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:23:21.384757 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:40113
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:43635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:21.461191 22289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:21.461354 22289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:21.461374 22289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:21.462332 22289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:21.462363 22289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:21.462387 22289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:23:21.463657 22289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:43635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:40113
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:21.463835 22289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:21.464006 22289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:21.468377 22295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:21.468364 22294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:21.468604 22297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:21.468575 22289 server_base.cc:1034] running on GCE node
I20260809 23:23:21.468798 22289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:21.469020 22289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:21.470227 22289 hybrid_clock.cc:648] HybridClock initialized: now 1786317801470181 us; error 23 us; skew 500 ppm
Aug 09 23:23:21 dist-test-slave-6nmv krb5kdc[22031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317801, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:21.472621 22289 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:23:21.473119 22289 webserver.cc:460] Webserver started at http://127.1.235.130:46801/ using document root <none> and password file <none>
I20260809 23:23:21.473361 22289 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:21.473439 22289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:21.473594 22289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:21.474634 22289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "9a4e6af9324d4301942737df576871ec"
format_stamp: "Formatted at 2026-08-09 23:23:21 on dist-test-slave-6nmv"
server_key: "508357deb86546170a810349851dd0e2"
server_key_iv: "7b4ee72c5fa9b52f8d289a2381018f39"
server_key_version: "encryptionkey@0"
I20260809 23:23:21.474980 22289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "9a4e6af9324d4301942737df576871ec"
format_stamp: "Formatted at 2026-08-09 23:23:21 on dist-test-slave-6nmv"
server_key: "508357deb86546170a810349851dd0e2"
server_key_iv: "7b4ee72c5fa9b52f8d289a2381018f39"
server_key_version: "encryptionkey@0"
I20260809 23:23:21.476296 22289 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 23:23:21.477051 22305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:21.477233 22289 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:23:21.477330 22289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "9a4e6af9324d4301942737df576871ec"
format_stamp: "Formatted at 2026-08-09 23:23:21 on dist-test-slave-6nmv"
server_key: "508357deb86546170a810349851dd0e2"
server_key_iv: "7b4ee72c5fa9b52f8d289a2381018f39"
server_key_version: "encryptionkey@0"
I20260809 23:23:21.477438 22289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:21.513356 22289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:21.515270 22289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:21.515424 22289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:21.515633 22289 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:21.515899 22289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:21.515949 22289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:21.515983 22289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:21.516008 22289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:21.521242 22289 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:38391
I20260809 23:23:21.521284 22437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:38391 every 8 connection(s)
I20260809 23:23:21.521559 22289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
Aug 09 23:23:21 dist-test-slave-6nmv krb5kdc[22031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317801, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:21.529022 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 22289
I20260809 23:23:21.529122 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:23:21.529311 1966 external_mini_cluster.cc:1428] Setting key 7aa97df4924f6c3d20ab2963af37fac8
I20260809 23:23:21.529632 22142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.522164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:55773 (local address 127.1.235.190:40113)
0809 23:23:21.522207 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:21.522209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:21.522408 (+ 199us) server_negotiation.cc:407] Connection header received
0809 23:23:21.522852 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:21.522853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:21.522864 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:21.522927 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:21.523812 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.524317 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.525287 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.525465 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.525546 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.527432 (+ 1886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:21.527433 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:21.527433 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:21.527439 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:21.528458 (+ 1019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:21.528762 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:21.528763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:21.528763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:21.528807 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:21.529043 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:21.529043 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:21.529044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:21.529173 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:21.529246 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:21.529473 (+ 227us) server_negotiation.cc:299] Negotiation successful
0809 23:23:21.529553 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 23:23:21.529747 22440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.522144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40113 (local address 127.1.235.130:55773)
0809 23:23:21.522302 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:21.522330 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:21.522756 (+ 426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:21.522985 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:21.522988 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:21.523539 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:21.523707 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:21.523711 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.524422 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.524423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:21.525201 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:21.525203 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.525554 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.525555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:21.525678 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.526155 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:21.526162 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:21.527350 (+ 1188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:21.528520 (+ 1170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:21.528525 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:21.528527 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:21.528705 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:21.528905 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:21.528905 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:21.528905 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:21.528985 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:21.529236 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:21.529241 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:21.529331 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 23:23:21.529440 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 23:23:21.529568 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
I20260809 23:23:21.530365 22438 heartbeater.cc:347] Connected to a master server at 127.1.235.190:40113
I20260809 23:23:21.530457 22438 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:21.530619 22438 heartbeater.cc:511] Master 127.1.235.190:40113 requested a full tablet report, sending...
I20260809 23:23:21.530943 22080 ts_manager.cc:194] Registered new tserver with Master: 9a4e6af9324d4301942737df576871ec (127.1.235.130:38391)
I20260809 23:23:21.531263 22080 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:55773
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:23:21.552392 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:40113
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:43635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:21.625758 22443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:21.625975 22443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:21.626012 22443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:21.627029 22443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:21.627086 22443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:21.627125 22443 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:23:21.628394 22443 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:43635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:40113
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22443
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:21.628623 22443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:21.628841 22443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 23:23:21.633831 22443 server_base.cc:1034] running on GCE node
W20260809 23:23:21.633944 22449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:21.633953 22451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:21.633955 22448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:21.634281 22443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:21.634460 22443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:21.635588 22443 hybrid_clock.cc:648] HybridClock initialized: now 1786317801635580 us; error 28 us; skew 500 ppm
Aug 09 23:23:21 dist-test-slave-6nmv krb5kdc[22031](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317801, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:21.637732 22443 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:23:21.638221 22443 webserver.cc:460] Webserver started at http://127.1.235.131:45457/ using document root <none> and password file <none>
I20260809 23:23:21.638453 22443 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:21.638517 22443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:21.638651 22443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:21.639657 22443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "5dc1680796554c4a987967a2639fce2a"
format_stamp: "Formatted at 2026-08-09 23:23:21 on dist-test-slave-6nmv"
server_key: "4c307d0ced4e4dd7df2ca881dcb2d5ec"
server_key_iv: "d909d0c0ec5e016fba8f15fda3b462de"
server_key_version: "encryptionkey@0"
I20260809 23:23:21.640026 22443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "5dc1680796554c4a987967a2639fce2a"
format_stamp: "Formatted at 2026-08-09 23:23:21 on dist-test-slave-6nmv"
server_key: "4c307d0ced4e4dd7df2ca881dcb2d5ec"
server_key_iv: "d909d0c0ec5e016fba8f15fda3b462de"
server_key_version: "encryptionkey@0"
I20260809 23:23:21.641350 22443 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:23:21.642118 22460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:21.642282 22443 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:23:21.642372 22443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "5dc1680796554c4a987967a2639fce2a"
format_stamp: "Formatted at 2026-08-09 23:23:21 on dist-test-slave-6nmv"
server_key: "4c307d0ced4e4dd7df2ca881dcb2d5ec"
server_key_iv: "d909d0c0ec5e016fba8f15fda3b462de"
server_key_version: "encryptionkey@0"
I20260809 23:23:21.642445 22443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:21.652361 22443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:21.654125 22443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:21.654286 22443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:21.654496 22443 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:21.654770 22443 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:21.654824 22443 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:21.654860 22443 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:21.654917 22443 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:21.660871 22443 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:36403
I20260809 23:23:21.660941 22583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:36403 every 8 connection(s)
I20260809 23:23:21.661232 22443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:23:21.666534 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 22443
I20260809 23:23:21.666632 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:23:21.666760 1966 external_mini_cluster.cc:1428] Setting key 661a5726c76467fdf50682abf698ffc6
Aug 09 23:23:21 dist-test-slave-6nmv krb5kdc[22031](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317801, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:21.670284 22142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.661848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:39971 (local address 127.1.235.190:40113)
0809 23:23:21.661904 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:21.661906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:21.662079 (+ 173us) server_negotiation.cc:407] Connection header received
0809 23:23:21.662585 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:21.662587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:21.662600 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:21.662650 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:21.663510 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.664046 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.665011 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.665239 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.665324 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.667758 (+ 2434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:21.667759 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:21.667759 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:21.667764 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:21.669246 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:21.669560 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:21.669561 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:21.669561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:21.669607 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:21.669786 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:21.669786 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:21.669786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:21.669929 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:21.669977 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:21.670175 (+ 198us) server_negotiation.cc:299] Negotiation successful
0809 23:23:21.670230 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 23:23:21.670389 22586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.661800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:40113 (local address 127.1.235.131:39971)
0809 23:23:21.661974 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:21.662002 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:21.662474 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:21.662706 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:21.662710 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:21.663245 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:21.663412 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:21.663416 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.664142 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.664143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:21.664918 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:21.664920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.665337 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.665338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:21.665453 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.665952 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:21.665959 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:21.667687 (+ 1728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:21.669312 (+ 1625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:21.669317 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:21.669318 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:21.669500 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:21.669659 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:21.669659 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:21.669660 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:21.669739 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:21.669981 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:21.669986 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:21.670076 (+ 90us) client_negotiation.cc:769] Sending connection context
0809 23:23:21.670148 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 23:23:21.670242 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":81,"threads_started":1}
I20260809 23:23:21.670769 22584 heartbeater.cc:347] Connected to a master server at 127.1.235.190:40113
I20260809 23:23:21.670833 22584 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:21.671036 22584 heartbeater.cc:511] Master 127.1.235.190:40113 requested a full tablet report, sending...
I20260809 23:23:21.671368 22080 ts_manager.cc:194] Registered new tserver with Master: 5dc1680796554c4a987967a2639fce2a (127.1.235.131:36403)
I20260809 23:23:21.671741 22080 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:39971
I20260809 23:23:21.678313 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:23:21.685345 22142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.679606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34482 (local address 127.1.235.190:40113)
0809 23:23:21.679663 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:21.679664 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:21.679796 (+ 132us) server_negotiation.cc:407] Connection header received
0809 23:23:21.679881 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:21.679881 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:21.679890 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:21.679931 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:21.680481 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.680883 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.681587 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.681771 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.681856 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.682971 (+ 1115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:21.682973 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:21.682973 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:21.682979 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:21.684129 (+ 1150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:21.684561 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:21.684562 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:21.684563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:21.684620 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:21.684830 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:21.684831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:21.684831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:21.684962 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:21.685071 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:21.685205 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 23:23:21.685261 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 23:23:21.686720 22080 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34482:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:23:21.688112 22080 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:23:21.694041 22593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.690044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:39065 (local address 127.0.0.1:33788)
0809 23:23:21.690192 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:21.690222 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:21.690298 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:21.690725 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:21.690726 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:21.690727 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:21.690767 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:21.690768 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.691998 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.691999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:21.692715 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:21.692717 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.693705 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.693706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:21.693785 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.693800 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 23:23:21.693901 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 23:23:21.693959 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":55,"threads_started":1}
I20260809 23:23:21.694144 22596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.690061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:36403 (local address 127.0.0.1:43958)
0809 23:23:21.690346 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:21.690356 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:21.690418 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:21.690626 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:21.690628 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:21.690630 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:21.690697 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:21.690699 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.691965 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.691966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:21.693071 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:21.693074 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.693878 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.693879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:21.693942 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.693946 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:23:21.694000 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 23:23:21.694042 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":26,"thread_start_us":51,"threads_started":1}
I20260809 23:23:21.694383 22592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.690228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:38391 (local address 127.0.0.1:48468)
0809 23:23:21.690347 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:21.690357 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:21.690394 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:21.690818 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:21.690818 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:21.690820 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:21.690862 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:21.690864 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.691820 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.691821 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:21.693241 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:21.693243 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.694173 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.694173 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:21.694235 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.694240 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 23:23:21.694288 (+ 48us) client_negotiation.cc:240] Negotiation successful
0809 23:23:21.694322 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":25,"thread_start_us":63,"threads_started":1}
I20260809 23:23:21.694408 22595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.690145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33788 (local address 127.1.235.129:39065)
0809 23:23:21.690517 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:21.690521 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:21.690531 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:23:21.690567 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:21.690570 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:21.690604 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:21.690726 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:21.690859 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.691879 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.692804 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.693561 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.693631 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.693680 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:21.694243 (+ 563us) server_negotiation.cc:299] Negotiation successful
0809 23:23:21.694297 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":66,"threads_started":1}
I20260809 23:23:21.694597 22594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.690132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43958 (local address 127.1.235.131:36403)
0809 23:23:21.690302 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:21.690305 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:21.690476 (+ 171us) server_negotiation.cc:407] Connection header received
0809 23:23:21.690508 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:21.690510 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:21.690521 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:21.690616 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:21.690771 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.691855 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.693161 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.693765 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.693876 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.693934 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:21.694022 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 23:23:21.694061 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":73,"threads_started":1}
I20260809 23:23:21.694619 22597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.690448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48468 (local address 127.1.235.130:38391)
0809 23:23:21.690638 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:21.690658 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:21.690665 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:23:21.690702 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:21.690704 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:21.690717 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:21.690778 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:21.690962 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.691717 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.693309 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.694030 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.694090 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.694138 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:21.694491 (+ 353us) server_negotiation.cc:299] Negotiation successful
0809 23:23:21.694531 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":77,"threads_started":1}
I20260809 23:23:21.695116 22215 tablet_service.cc:1467] Processing CreateTablet for tablet 8caab13ba5f345dc80b035699f29e9ba (DEFAULT_TABLE table=test-table [id=05685d1f84db4dafaaeb8288988ff99c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:21.695175 22512 tablet_service.cc:1467] Processing CreateTablet for tablet 8caab13ba5f345dc80b035699f29e9ba (DEFAULT_TABLE table=test-table [id=05685d1f84db4dafaaeb8288988ff99c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:21.695197 22364 tablet_service.cc:1467] Processing CreateTablet for tablet 8caab13ba5f345dc80b035699f29e9ba (DEFAULT_TABLE table=test-table [id=05685d1f84db4dafaaeb8288988ff99c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:21.695475 22215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8caab13ba5f345dc80b035699f29e9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:21.695475 22364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8caab13ba5f345dc80b035699f29e9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:21.695472 22512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8caab13ba5f345dc80b035699f29e9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:21.698668 22598 tablet_bootstrap.cc:492] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a: Bootstrap starting.
I20260809 23:23:21.698724 22599 tablet_bootstrap.cc:492] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec: Bootstrap starting.
I20260809 23:23:21.699290 22598 tablet_bootstrap.cc:654] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:21.699290 22599 tablet_bootstrap.cc:654] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:21.699896 22598 log.cc:824] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:21.699892 22599 log.cc:824] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:21.700223 22600 tablet_bootstrap.cc:492] T 8caab13ba5f345dc80b035699f29e9ba P e59bc576741f403186b324584d236dbe: Bootstrap starting.
I20260809 23:23:21.700676 22599 tablet_bootstrap.cc:492] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec: No bootstrap required, opened a new log
I20260809 23:23:21.700752 22599 ts_tablet_manager.cc:1397] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:23:21.700824 22598 tablet_bootstrap.cc:492] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a: No bootstrap required, opened a new log
I20260809 23:23:21.700872 22600 tablet_bootstrap.cc:654] T 8caab13ba5f345dc80b035699f29e9ba P e59bc576741f403186b324584d236dbe: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:21.700912 22598 ts_tablet_manager.cc:1397] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:23:21.701390 22600 log.cc:824] T 8caab13ba5f345dc80b035699f29e9ba P e59bc576741f403186b324584d236dbe: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:21.702179 22600 tablet_bootstrap.cc:492] T 8caab13ba5f345dc80b035699f29e9ba P e59bc576741f403186b324584d236dbe: No bootstrap required, opened a new log
I20260809 23:23:21.702243 22600 ts_tablet_manager.cc:1397] T 8caab13ba5f345dc80b035699f29e9ba P e59bc576741f403186b324584d236dbe: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:23:21.702435 22598 raft_consensus.cc:348] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e59bc576741f403186b324584d236dbe" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39065 } } peers { permanent_uuid: "5dc1680796554c4a987967a2639fce2a" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36403 } } peers { permanent_uuid: "9a4e6af9324d4301942737df576871ec" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38391 } }
I20260809 23:23:21.702569 22598 raft_consensus.cc:374] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:21.702610 22598 raft_consensus.cc:729] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc1680796554c4a987967a2639fce2a, State: Initialized, Role: FOLLOWER
I20260809 23:23:21.702720 22598 consensus_queue.cc:260] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e59bc576741f403186b324584d236dbe" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39065 } } peers { permanent_uuid: "5dc1680796554c4a987967a2639fce2a" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36403 } } peers { permanent_uuid: "9a4e6af9324d4301942737df576871ec" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38391 } }
I20260809 23:23:21.702780 22599 raft_consensus.cc:348] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e59bc576741f403186b324584d236dbe" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39065 } } peers { permanent_uuid: "5dc1680796554c4a987967a2639fce2a" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36403 } } peers { permanent_uuid: "9a4e6af9324d4301942737df576871ec" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38391 } }
I20260809 23:23:21.702952 22599 raft_consensus.cc:374] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:21.702994 22599 raft_consensus.cc:729] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a4e6af9324d4301942737df576871ec, State: Initialized, Role: FOLLOWER
I20260809 23:23:21.702996 22598 ts_tablet_manager.cc:1428] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:23:21.703122 22584 heartbeater.cc:503] Master 127.1.235.190:40113 was elected leader, sending a full tablet report...
I20260809 23:23:21.703125 22599 consensus_queue.cc:260] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e59bc576741f403186b324584d236dbe" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39065 } } peers { permanent_uuid: "5dc1680796554c4a987967a2639fce2a" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36403 } } peers { permanent_uuid: "9a4e6af9324d4301942737df576871ec" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38391 } }
I20260809 23:23:21.703470 22599 ts_tablet_manager.cc:1428] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:23:21.703492 22438 heartbeater.cc:503] Master 127.1.235.190:40113 was elected leader, sending a full tablet report...
I20260809 23:23:21.704046 22600 raft_consensus.cc:348] T 8caab13ba5f345dc80b035699f29e9ba P e59bc576741f403186b324584d236dbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e59bc576741f403186b324584d236dbe" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39065 } } peers { permanent_uuid: "5dc1680796554c4a987967a2639fce2a" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36403 } } peers { permanent_uuid: "9a4e6af9324d4301942737df576871ec" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38391 } }
I20260809 23:23:21.704205 22600 raft_consensus.cc:374] T 8caab13ba5f345dc80b035699f29e9ba P e59bc576741f403186b324584d236dbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:21.704263 22600 raft_consensus.cc:729] T 8caab13ba5f345dc80b035699f29e9ba P e59bc576741f403186b324584d236dbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e59bc576741f403186b324584d236dbe, State: Initialized, Role: FOLLOWER
I20260809 23:23:21.704391 22600 consensus_queue.cc:260] T 8caab13ba5f345dc80b035699f29e9ba P e59bc576741f403186b324584d236dbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e59bc576741f403186b324584d236dbe" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39065 } } peers { permanent_uuid: "5dc1680796554c4a987967a2639fce2a" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36403 } } peers { permanent_uuid: "9a4e6af9324d4301942737df576871ec" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38391 } }
I20260809 23:23:21.704658 22600 ts_tablet_manager.cc:1428] T 8caab13ba5f345dc80b035699f29e9ba P e59bc576741f403186b324584d236dbe: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 23:23:21.704669 22284 heartbeater.cc:503] Master 127.1.235.190:40113 was elected leader, sending a full tablet report...
I20260809 23:23:21.726503 22605 raft_consensus.cc:482] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:23:21.726570 22605 raft_consensus.cc:504] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e59bc576741f403186b324584d236dbe" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39065 } } peers { permanent_uuid: "5dc1680796554c4a987967a2639fce2a" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36403 } } peers { permanent_uuid: "9a4e6af9324d4301942737df576871ec" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38391 } }
I20260809 23:23:21.726851 22605 leader_election.cc:288] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e59bc576741f403186b324584d236dbe (127.1.235.129:39065), 9a4e6af9324d4301942737df576871ec (127.1.235.130:38391)
I20260809 23:23:21.730312 22595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.727105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:50555 (local address 127.1.235.129:39065)
0809 23:23:21.727150 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:21.727152 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:21.727160 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:23:21.727182 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:21.727183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:21.727192 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:21.727249 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:21.727391 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.728106 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.729363 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.729967 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.730033 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.730043 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:21.730222 (+ 179us) server_negotiation.cc:299] Negotiation successful
0809 23:23:21.730255 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260809 23:23:21.730312 22597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.727175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:55019 (local address 127.1.235.130:38391)
0809 23:23:21.727209 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:21.727210 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:21.727337 (+ 127us) server_negotiation.cc:407] Connection header received
0809 23:23:21.727411 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:21.727412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:21.727420 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:21.727474 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:21.727594 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.728226 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.729435 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.730000 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.730063 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.730068 (+ 5us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:21.730223 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 23:23:21.730255 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 23:23:21.730338 22586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.727005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:39065 (local address 127.1.235.131:50555)
0809 23:23:21.727062 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:21.727072 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:21.727115 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:21.727253 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:21.727254 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:21.727255 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:21.727319 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:21.727320 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.728187 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.728188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:21.729280 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:21.729282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.730065 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.730066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:21.730143 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.730146 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:23:21.730203 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 23:23:21.730247 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":4}
I20260809 23:23:21.730351 22609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.727122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:38391 (local address 127.1.235.131:55019)
0809 23:23:21.727275 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:21.727285 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:21.727337 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:21.727486 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:21.727487 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:21.727488 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:21.727531 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:21.727532 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.728297 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.728298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:21.729352 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:21.729354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.730066 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.730066 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:21.730143 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.730146 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:23:21.730203 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 23:23:21.730247 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":16,"thread_start_us":112,"threads_started":1}
I20260809 23:23:21.730664 22237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caab13ba5f345dc80b035699f29e9ba" candidate_uuid: "5dc1680796554c4a987967a2639fce2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e59bc576741f403186b324584d236dbe" is_pre_election: true
I20260809 23:23:21.730786 22237 raft_consensus.cc:2454] T 8caab13ba5f345dc80b035699f29e9ba P e59bc576741f403186b324584d236dbe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dc1680796554c4a987967a2639fce2a in term 0.
I20260809 23:23:21.730806 22388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caab13ba5f345dc80b035699f29e9ba" candidate_uuid: "5dc1680796554c4a987967a2639fce2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a4e6af9324d4301942737df576871ec" is_pre_election: true
I20260809 23:23:21.730928 22388 raft_consensus.cc:2454] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dc1680796554c4a987967a2639fce2a in term 0.
I20260809 23:23:21.731007 22464 leader_election.cc:302] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc1680796554c4a987967a2639fce2a, e59bc576741f403186b324584d236dbe; no voters:
I20260809 23:23:21.731146 22605 raft_consensus.cc:2781] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:23:21.731191 22605 raft_consensus.cc:482] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:23:21.731206 22605 raft_consensus.cc:3037] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:21.731843 22605 raft_consensus.cc:504] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e59bc576741f403186b324584d236dbe" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39065 } } peers { permanent_uuid: "5dc1680796554c4a987967a2639fce2a" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36403 } } peers { permanent_uuid: "9a4e6af9324d4301942737df576871ec" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38391 } }
I20260809 23:23:21.731936 22605 leader_election.cc:288] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [CANDIDATE]: Term 1 election: Requested vote from peers e59bc576741f403186b324584d236dbe (127.1.235.129:39065), 9a4e6af9324d4301942737df576871ec (127.1.235.130:38391)
I20260809 23:23:21.732151 22237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caab13ba5f345dc80b035699f29e9ba" candidate_uuid: "5dc1680796554c4a987967a2639fce2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e59bc576741f403186b324584d236dbe"
I20260809 23:23:21.732223 22237 raft_consensus.cc:3037] T 8caab13ba5f345dc80b035699f29e9ba P e59bc576741f403186b324584d236dbe [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:21.732182 22388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caab13ba5f345dc80b035699f29e9ba" candidate_uuid: "5dc1680796554c4a987967a2639fce2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a4e6af9324d4301942737df576871ec"
I20260809 23:23:21.732275 22388 raft_consensus.cc:3037] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:21.732900 22388 raft_consensus.cc:2454] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc1680796554c4a987967a2639fce2a in term 1.
I20260809 23:23:21.732906 22237 raft_consensus.cc:2454] T 8caab13ba5f345dc80b035699f29e9ba P e59bc576741f403186b324584d236dbe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dc1680796554c4a987967a2639fce2a in term 1.
I20260809 23:23:21.733093 22464 leader_election.cc:302] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc1680796554c4a987967a2639fce2a, 9a4e6af9324d4301942737df576871ec; no voters:
I20260809 23:23:21.733192 22605 raft_consensus.cc:2781] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:21.733311 22605 raft_consensus.cc:686] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [term 1 LEADER]: Becoming Leader. State: Replica: 5dc1680796554c4a987967a2639fce2a, State: Running, Role: LEADER
I20260809 23:23:21.733543 22605 consensus_queue.cc:237] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e59bc576741f403186b324584d236dbe" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39065 } } peers { permanent_uuid: "5dc1680796554c4a987967a2639fce2a" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36403 } } peers { permanent_uuid: "9a4e6af9324d4301942737df576871ec" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38391 } }
I20260809 23:23:21.734326 22079 catalog_manager.cc:5495] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5dc1680796554c4a987967a2639fce2a (127.1.235.131). New cstate: current_term: 1 leader_uuid: "5dc1680796554c4a987967a2639fce2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e59bc576741f403186b324584d236dbe" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5dc1680796554c4a987967a2639fce2a" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a4e6af9324d4301942737df576871ec" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38391 } health_report { overall_health: UNKNOWN } } }
I20260809 23:23:21.739102 22594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.736882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43960 (local address 127.1.235.131:36403)
0809 23:23:21.736923 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:21.736925 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:21.736941 (+ 16us) server_negotiation.cc:407] Connection header received
0809 23:23:21.736999 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:21.737000 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:21.737014 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:21.737095 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:23:21.737239 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.737630 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.738384 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.738570 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.738644 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.738797 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:23:21.738878 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:23:21.738988 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:21.739019 (+ 31us) server_negotiation.cc:299] Negotiation successful
0809 23:23:21.739028 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:23:21.740628 22237 raft_consensus.cc:1261] T 8caab13ba5f345dc80b035699f29e9ba P e59bc576741f403186b324584d236dbe [term 1 FOLLOWER]: Refusing update from remote peer 5dc1680796554c4a987967a2639fce2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:23:21.740859 22388 raft_consensus.cc:1261] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec [term 1 FOLLOWER]: Refusing update from remote peer 5dc1680796554c4a987967a2639fce2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:23:21.740911 22610 consensus_queue.cc:1035] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e59bc576741f403186b324584d236dbe" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 39065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:23:21.741151 22610 consensus_queue.cc:1035] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a4e6af9324d4301942737df576871ec" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 38391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:23:21.744858 22616 mvcc.cc:205] Tried to move back new op lower bound from 7316757715927191552 to 7316757715901317120. Current Snapshot: MvccSnapshot[applied={T|T < 7316757715927191552 or (T in {7316757715927191552})}]
I20260809 23:23:21.745107 22079 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:23:21.745189 22079 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:23:21.745838 22079 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9dba6f0b9f9f4f9ca2fabdd4eaab51f4: Sending DeleteTablet for 3 replicas of tablet 8caab13ba5f345dc80b035699f29e9ba
I20260809 23:23:21.746121 22215 tablet_service.cc:1514] Processing DeleteTablet for tablet 8caab13ba5f345dc80b035699f29e9ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:21 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:33788
I20260809 23:23:21.746215 22364 tablet_service.cc:1514] Processing DeleteTablet for tablet 8caab13ba5f345dc80b035699f29e9ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:21 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:48468
I20260809 23:23:21.746383 22622 tablet_replica.cc:330] T 8caab13ba5f345dc80b035699f29e9ba P e59bc576741f403186b324584d236dbe: stopping tablet replica
I20260809 23:23:21.746485 22622 raft_consensus.cc:2229] T 8caab13ba5f345dc80b035699f29e9ba P e59bc576741f403186b324584d236dbe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:23:21.746572 22512 tablet_service.cc:1514] Processing DeleteTablet for tablet 8caab13ba5f345dc80b035699f29e9ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:21 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:43958
I20260809 23:23:21.746619 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 22145
I20260809 23:23:21.750551 22624 tablet_replica.cc:330] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a: stopping tablet replica
I20260809 23:23:21.750640 22624 raft_consensus.cc:2229] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:23:21.750720 22624 raft_consensus.cc:2258] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:23:21.750880 22623 tablet_replica.cc:330] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec: stopping tablet replica
I20260809 23:23:21.750962 22623 raft_consensus.cc:2229] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:23:21.751062 22623 raft_consensus.cc:2258] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:23:21.751359 22624 ts_tablet_manager.cc:1905] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:23:21.751464 22623 ts_tablet_manager.cc:1905] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:23:21.752835 22624 ts_tablet_manager.cc:1918] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:23:21.752912 22624 log.cc:1196] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/8caab13ba5f345dc80b035699f29e9ba
I20260809 23:23:21.753221 22624 ts_tablet_manager.cc:1939] T 8caab13ba5f345dc80b035699f29e9ba P 5dc1680796554c4a987967a2639fce2a: Deleting consensus metadata
I20260809 23:23:21.753341 22623 ts_tablet_manager.cc:1918] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:23:21.753427 22623 log.cc:1196] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/8caab13ba5f345dc80b035699f29e9ba
I20260809 23:23:21.753588 22066 catalog_manager.cc:4841] TS 5dc1680796554c4a987967a2639fce2a (127.1.235.131:36403): tablet 8caab13ba5f345dc80b035699f29e9ba (table test-table [id=05685d1f84db4dafaaeb8288988ff99c]) successfully deleted
I20260809 23:23:21.753710 22623 ts_tablet_manager.cc:1939] T 8caab13ba5f345dc80b035699f29e9ba P 9a4e6af9324d4301942737df576871ec: Deleting consensus metadata
I20260809 23:23:21.754309 22065 catalog_manager.cc:4841] TS 9a4e6af9324d4301942737df576871ec (127.1.235.130:38391): tablet 8caab13ba5f345dc80b035699f29e9ba (table test-table [id=05685d1f84db4dafaaeb8288988ff99c]) successfully deleted
W20260809 23:23:21.757468 22065 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.235.129:39065 (error 108)
I20260809 23:23:21.757964 22592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.757830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:39065 (local address 127.0.0.1:33796)
0809 23:23:21.757883 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:21.757926 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.129:39065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260809 23:23:21.758112 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 22289
W20260809 23:23:21.758131 22065 catalog_manager.cc:4584] TS e59bc576741f403186b324584d236dbe (127.1.235.129:39065): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8caab13ba5f345dc80b035699f29e9ba: Network error: Client connection negotiation failed: client connection to 127.1.235.129:39065: connect: Connection refused (error 111)
I20260809 23:23:21.767529 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 22443
I20260809 23:23:21.773638 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 22046
2026-08-09T23:23:21Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (1850 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T23:23:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:21Z Disabled control of system clock
I20260809 23:23:21.801882 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:35441
--webserver_interface=127.1.235.190
--webserver_port=0
--builtin_ntp_servers=127.1.235.148:35859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:35441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 23:23:21.875804 22630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:21.876008 22630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:21.876026 22630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:21.876977 22630 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:21.877008 22630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:21.877018 22630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:21.877029 22630 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:21.877039 22630 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:21.878118 22630 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:35859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:35441
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:35441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:21.878294 22630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:21.878487 22630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:21.882598 22636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:21.882656 22635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:21.882587 22638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:21.882802 22630 server_base.cc:1034] running on GCE node
I20260809 23:23:21.883044 22630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:21.883339 22630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:21.884534 22630 hybrid_clock.cc:648] HybridClock initialized: now 1786317801884518 us; error 31 us; skew 500 ppm
I20260809 23:23:21.885684 22630 webserver.cc:460] Webserver started at http://127.1.235.190:44641/ using document root <none> and password file <none>
I20260809 23:23:21.885970 22630 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:21.886037 22630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:21.886163 22630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:21.887076 22630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "377a5103d76d4135b57492de27e4efaa"
format_stamp: "Formatted at 2026-08-09 23:23:21 on dist-test-slave-6nmv"
server_key: "10539fd21eac8ce962062efb688f41ee"
server_key_iv: "9765d61fdc8a10d6e69e1270c978311a"
server_key_version: "encryptionkey@0"
I20260809 23:23:21.887403 22630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "377a5103d76d4135b57492de27e4efaa"
format_stamp: "Formatted at 2026-08-09 23:23:21 on dist-test-slave-6nmv"
server_key: "10539fd21eac8ce962062efb688f41ee"
server_key_iv: "9765d61fdc8a10d6e69e1270c978311a"
server_key_version: "encryptionkey@0"
I20260809 23:23:21.888608 22630 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:23:21.889308 22644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:21.889465 22630 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:21.889567 22630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "377a5103d76d4135b57492de27e4efaa"
format_stamp: "Formatted at 2026-08-09 23:23:21 on dist-test-slave-6nmv"
server_key: "10539fd21eac8ce962062efb688f41ee"
server_key_iv: "9765d61fdc8a10d6e69e1270c978311a"
server_key_version: "encryptionkey@0"
I20260809 23:23:21.889653 22630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:21.920928 22630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:21.921229 22630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:21.921375 22630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:21.925156 22630 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:35441
I20260809 23:23:21.925187 22703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:35441 every 8 connection(s)
I20260809 23:23:21.925482 22630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:21.925953 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 22630
I20260809 23:23:21.926074 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:21.926265 1966 external_mini_cluster.cc:1428] Setting key 3a79b5f83486a6c3482c04d142a56bc4
I20260809 23:23:21.926587 22704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:21.929092 22704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa: Bootstrap starting.
I20260809 23:23:21.929698 22704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:21.930023 22704 log.cc:824] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:21.930755 22704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa: No bootstrap required, opened a new log
I20260809 23:23:21.931525 22707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:21.926743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42396 (local address 127.1.235.190:35441)
0809 23:23:21.926956 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:21.926963 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:21.926985 (+ 22us) server_negotiation.cc:407] Connection header received
0809 23:23:21.927500 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:21.927506 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:21.927566 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:21.927711 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:21.927929 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.928733 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.929583 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:21.930112 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:21.930243 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:21.930940 (+ 697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:21.930944 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:21.930945 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:21.931101 (+ 156us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:21.931133 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:21.931143 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:21.931213 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:21.931286 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 23:23:21.931359 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":90,"threads_started":1}
I20260809 23:23:21.932780 22704 raft_consensus.cc:348] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "377a5103d76d4135b57492de27e4efaa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35441 } }
I20260809 23:23:21.932920 22704 raft_consensus.cc:374] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:21.932967 22704 raft_consensus.cc:729] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 377a5103d76d4135b57492de27e4efaa, State: Initialized, Role: FOLLOWER
I20260809 23:23:21.933115 22704 consensus_queue.cc:260] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "377a5103d76d4135b57492de27e4efaa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35441 } }
I20260809 23:23:21.933195 22704 raft_consensus.cc:388] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:21.933238 22704 raft_consensus.cc:482] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:21.933290 22704 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:21.933789 22704 raft_consensus.cc:504] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "377a5103d76d4135b57492de27e4efaa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35441 } }
I20260809 23:23:21.933947 22704 leader_election.cc:302] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 377a5103d76d4135b57492de27e4efaa; no voters:
I20260809 23:23:21.934145 22704 leader_election.cc:288] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:21.934194 22709 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:21.934355 22709 raft_consensus.cc:686] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [term 1 LEADER]: Becoming Leader. State: Replica: 377a5103d76d4135b57492de27e4efaa, State: Running, Role: LEADER
I20260809 23:23:21.934433 22704 sys_catalog.cc:564] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:21.934435 22709 consensus_queue.cc:237] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "377a5103d76d4135b57492de27e4efaa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35441 } }
I20260809 23:23:21.934813 22710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "377a5103d76d4135b57492de27e4efaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "377a5103d76d4135b57492de27e4efaa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35441 } } }
I20260809 23:23:21.934813 22711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 377a5103d76d4135b57492de27e4efaa. Latest consensus state: current_term: 1 leader_uuid: "377a5103d76d4135b57492de27e4efaa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "377a5103d76d4135b57492de27e4efaa" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35441 } } }
I20260809 23:23:21.934926 22710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:21.934935 22711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:21.935138 22716 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:21.935560 22716 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:21.936973 22716 catalog_manager.cc:1347] Generated new cluster ID: c0b793891ae44369ae084797f2e2fe28
I20260809 23:23:21.937023 22716 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:21.946483 22716 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:21.947116 22716 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:21.955305 22716 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa: Generated new TSK 0
I20260809 23:23:21.955456 22716 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:21.958590 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:35441
--builtin_ntp_servers=127.1.235.148:35859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 23:23:22.035348 22729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:22.035552 22729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:22.035574 22729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:22.036720 22729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:22.036757 22729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:22.036782 22729 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:23:22.038095 22729 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:35859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:35441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:22.038311 22729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:22.038604 22729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:22.044093 22736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:22.044059 22729 server_base.cc:1034] running on GCE node
W20260809 23:23:22.044066 22737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:22.044055 22739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:22.044485 22729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:22.044746 22729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:22.045863 22729 hybrid_clock.cc:648] HybridClock initialized: now 1786317802045842 us; error 35 us; skew 500 ppm
I20260809 23:23:22.047178 22729 webserver.cc:460] Webserver started at http://127.1.235.129:44651/ using document root <none> and password file <none>
I20260809 23:23:22.047451 22729 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:22.047495 22729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:22.047636 22729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:22.048581 22729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "0fe0c592a3a94ac7b77c61ca1ebc3af5"
format_stamp: "Formatted at 2026-08-09 23:23:22 on dist-test-slave-6nmv"
server_key: "a0c04fa5cfd87b15714d271ccb815372"
server_key_iv: "47d4d55ecf18ee573d4fb93c204efe03"
server_key_version: "encryptionkey@0"
I20260809 23:23:22.048899 22729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "0fe0c592a3a94ac7b77c61ca1ebc3af5"
format_stamp: "Formatted at 2026-08-09 23:23:22 on dist-test-slave-6nmv"
server_key: "a0c04fa5cfd87b15714d271ccb815372"
server_key_iv: "47d4d55ecf18ee573d4fb93c204efe03"
server_key_version: "encryptionkey@0"
I20260809 23:23:22.050174 22729 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:23:22.050932 22746 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:22.051076 22729 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:22.051154 22729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "0fe0c592a3a94ac7b77c61ca1ebc3af5"
format_stamp: "Formatted at 2026-08-09 23:23:22 on dist-test-slave-6nmv"
server_key: "a0c04fa5cfd87b15714d271ccb815372"
server_key_iv: "47d4d55ecf18ee573d4fb93c204efe03"
server_key_version: "encryptionkey@0"
I20260809 23:23:22.051216 22729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:22.068133 22729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:22.068356 22729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:22.068503 22729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:22.068696 22729 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:22.068964 22729 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:22.069012 22729 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:22.069047 22729 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:22.069070 22729 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:22.074496 22729 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:46069
I20260809 23:23:22.074570 22874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:46069 every 8 connection(s)
I20260809 23:23:22.074862 22729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:23:22.079476 22707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.075537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:56007 (local address 127.1.235.190:35441)
0809 23:23:22.075606 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:22.075609 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:22.075767 (+ 158us) server_negotiation.cc:407] Connection header received
0809 23:23:22.076315 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:22.076315 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:22.076328 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:22.076383 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:22.076925 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.077411 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.078323 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.078493 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.078540 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.079288 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:22.079289 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:22.079289 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:22.079293 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:22.079303 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:22.079306 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:22.079341 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:22.079403 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 23:23:22.079420 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 23:23:22.079689 22878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.075501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:35441 (local address 127.1.235.129:56007)
0809 23:23:22.075666 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:22.075694 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:22.076221 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:22.076416 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:22.076420 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:22.076427 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:22.076857 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:22.076860 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.077479 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.077479 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:22.078255 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:22.078258 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.078567 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.078567 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:22.078661 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.079179 (+ 518us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:23:22.079180 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:22.079205 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:23:22.079225 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:22.079343 (+ 118us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:22.079344 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:22.079346 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:23:22.079409 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 23:23:22.079523 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":81,"threads_started":1}
I20260809 23:23:22.080240 22875 heartbeater.cc:347] Connected to a master server at 127.1.235.190:35441
I20260809 23:23:22.080309 22875 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:22.080437 22875 heartbeater.cc:511] Master 127.1.235.190:35441 requested a full tablet report, sending...
I20260809 23:23:22.080861 22663 ts_manager.cc:194] Registered new tserver with Master: 0fe0c592a3a94ac7b77c61ca1ebc3af5 (127.1.235.129:46069)
I20260809 23:23:22.081387 22663 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.235.129:56007
I20260809 23:23:22.083964 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 22729
I20260809 23:23:22.084051 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:23:22.084193 1966 external_mini_cluster.cc:1428] Setting key 8aea658fe5f2513f5b670d36e1ab7958
I20260809 23:23:22.085018 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:35441
--builtin_ntp_servers=127.1.235.148:35859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 23:23:22.159780 22879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:22.159947 22879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:22.159967 22879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:22.160954 22879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:22.160987 22879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:22.161028 22879 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:23:22.162187 22879 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:35859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:35441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:22.162431 22879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:22.162699 22879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:22.167198 22888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:22.167250 22879 server_base.cc:1034] running on GCE node
W20260809 23:23:22.167193 22886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:22.167200 22885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:22.167572 22879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:22.167784 22879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:22.168928 22879 hybrid_clock.cc:648] HybridClock initialized: now 1786317802168935 us; error 43 us; skew 500 ppm
I20260809 23:23:22.170140 22879 webserver.cc:460] Webserver started at http://127.1.235.130:45775/ using document root <none> and password file <none>
I20260809 23:23:22.170354 22879 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:22.170415 22879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:22.170538 22879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:22.171478 22879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "3518d47218ab4c35be85d74c08c29f33"
format_stamp: "Formatted at 2026-08-09 23:23:22 on dist-test-slave-6nmv"
server_key: "d2cea47a0e7626b5218e47939d342a85"
server_key_iv: "9171e0e2ee646183b4eb08583b27e3c6"
server_key_version: "encryptionkey@0"
I20260809 23:23:22.171831 22879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "3518d47218ab4c35be85d74c08c29f33"
format_stamp: "Formatted at 2026-08-09 23:23:22 on dist-test-slave-6nmv"
server_key: "d2cea47a0e7626b5218e47939d342a85"
server_key_iv: "9171e0e2ee646183b4eb08583b27e3c6"
server_key_version: "encryptionkey@0"
I20260809 23:23:22.173058 22879 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:23:22.173774 22895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:22.173955 22879 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:22.174060 22879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "3518d47218ab4c35be85d74c08c29f33"
format_stamp: "Formatted at 2026-08-09 23:23:22 on dist-test-slave-6nmv"
server_key: "d2cea47a0e7626b5218e47939d342a85"
server_key_iv: "9171e0e2ee646183b4eb08583b27e3c6"
server_key_version: "encryptionkey@0"
I20260809 23:23:22.174144 22879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:22.190418 22879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:22.190654 22879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:22.190781 22879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:22.190969 22879 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:22.191255 22879 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:22.191305 22879 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:22.191339 22879 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:22.191365 22879 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:22.196823 22879 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:34259
I20260809 23:23:22.196926 23034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:34259 every 8 connection(s)
I20260809 23:23:22.197180 22879 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:23:22.200099 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 22879
I20260809 23:23:22.200210 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:23:22.200383 1966 external_mini_cluster.cc:1428] Setting key f8e48e50245c0c9f0ba46db9b71e00af
I20260809 23:23:22.201234 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:35441
--builtin_ntp_servers=127.1.235.148:35859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 23:23:22.202157 22707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.197839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:54325 (local address 127.1.235.190:35441)
0809 23:23:22.197896 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:22.197898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:22.198114 (+ 216us) server_negotiation.cc:407] Connection header received
0809 23:23:22.198552 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:22.198553 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:22.198566 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:22.198605 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:22.199166 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.199597 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.200735 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.200991 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.201044 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.201881 (+ 837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:22.201882 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:22.201883 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:22.201887 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:22.201904 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:22.201908 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:22.201968 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:22.202028 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 23:23:22.202054 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 23:23:22.202227 23039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.197803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:35441 (local address 127.1.235.130:54325)
0809 23:23:22.198015 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:22.198042 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:22.198447 (+ 405us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:22.198671 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:22.198675 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:22.198683 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:22.199084 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:22.199088 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.199682 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.199683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:22.200669 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:22.200672 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.201063 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.201063 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:22.201181 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.201756 (+ 575us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:23:22.201757 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:22.201781 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:23:22.201799 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:22.201969 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:22.201971 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:22.201973 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:23:22.202013 (+ 40us) client_negotiation.cc:240] Negotiation successful
0809 23:23:22.202077 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":91,"threads_started":1}
I20260809 23:23:22.202672 23035 heartbeater.cc:347] Connected to a master server at 127.1.235.190:35441
I20260809 23:23:22.202759 23035 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:22.202936 23035 heartbeater.cc:511] Master 127.1.235.190:35441 requested a full tablet report, sending...
I20260809 23:23:22.203343 22663 ts_manager.cc:194] Registered new tserver with Master: 3518d47218ab4c35be85d74c08c29f33 (127.1.235.130:34259)
I20260809 23:23:22.203704 22663 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.235.130:54325
W20260809 23:23:22.280613 23040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:22.280812 23040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:22.280845 23040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:22.281917 23040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:22.281967 23040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:22.282006 23040 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:23:22.283222 23040 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:35859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:35441
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:22.283480 23040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:22.283754 23040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:22.288223 23045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:22.288233 23048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:22.288388 23040 server_base.cc:1034] running on GCE node
W20260809 23:23:22.288224 23050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:22.288690 23040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:22.288908 23040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:22.290069 23040 hybrid_clock.cc:648] HybridClock initialized: now 1786317802290052 us; error 34 us; skew 500 ppm
I20260809 23:23:22.291217 23040 webserver.cc:460] Webserver started at http://127.1.235.131:44351/ using document root <none> and password file <none>
I20260809 23:23:22.291430 23040 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:22.291471 23040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:22.291600 23040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:22.292672 23040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f"
format_stamp: "Formatted at 2026-08-09 23:23:22 on dist-test-slave-6nmv"
server_key: "f9c63ac69d23721e727728d3fd0dfb35"
server_key_iv: "7f0deb7888673fee106702870fb91d54"
server_key_version: "encryptionkey@0"
I20260809 23:23:22.293006 23040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f"
format_stamp: "Formatted at 2026-08-09 23:23:22 on dist-test-slave-6nmv"
server_key: "f9c63ac69d23721e727728d3fd0dfb35"
server_key_iv: "7f0deb7888673fee106702870fb91d54"
server_key_version: "encryptionkey@0"
I20260809 23:23:22.294399 23040 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:23:22.295006 23056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:22.295195 23040 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:22.295271 23040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f"
format_stamp: "Formatted at 2026-08-09 23:23:22 on dist-test-slave-6nmv"
server_key: "f9c63ac69d23721e727728d3fd0dfb35"
server_key_iv: "7f0deb7888673fee106702870fb91d54"
server_key_version: "encryptionkey@0"
I20260809 23:23:22.295331 23040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:22.303212 23040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:22.303452 23040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:22.303572 23040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:22.303789 23040 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:22.304093 23040 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:22.304152 23040 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:22.304190 23040 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:22.304219 23040 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:22.309566 23040 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:39865
I20260809 23:23:22.309597 23184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:39865 every 8 connection(s)
I20260809 23:23:22.309938 23040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:23:22.314755 22707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.310583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:38719 (local address 127.1.235.190:35441)
0809 23:23:22.310629 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:22.310631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:22.310805 (+ 174us) server_negotiation.cc:407] Connection header received
0809 23:23:22.311255 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:22.311256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:22.311269 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:22.311341 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:22.311986 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.312472 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.313415 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.313614 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.313700 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.314489 (+ 789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:22.314490 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:22.314491 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:22.314495 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:22.314509 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:22.314513 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:22.314565 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:22.314654 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 23:23:22.314679 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 23:23:22.314971 23188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.310555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:35441 (local address 127.1.235.131:38719)
0809 23:23:22.310697 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:22.310732 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:22.311157 (+ 425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:22.311407 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:22.311410 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:22.311419 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:22.311881 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:22.311885 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.312561 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.312562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:22.313320 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:22.313322 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.313710 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.313711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:22.313914 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.314359 (+ 445us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:23:22.314360 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:22.314384 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:23:22.314405 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:22.314568 (+ 163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:22.314572 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:22.314575 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:23:22.314656 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 23:23:22.314744 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":59,"threads_started":1}
I20260809 23:23:22.315410 23185 heartbeater.cc:347] Connected to a master server at 127.1.235.190:35441
I20260809 23:23:22.315500 23185 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:22.315654 23185 heartbeater.cc:511] Master 127.1.235.190:35441 requested a full tablet report, sending...
I20260809 23:23:22.315982 22663 ts_manager.cc:194] Registered new tserver with Master: f80ce22cfcdd4fad9e695577ac2f3e9f (127.1.235.131:39865)
I20260809 23:23:22.316341 22663 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.235.131:38719
I20260809 23:23:22.317081 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 23040
I20260809 23:23:22.317191 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:23:22.317381 1966 external_mini_cluster.cc:1428] Setting key d3ec10ecb7095834585d02f9d727d11f
I20260809 23:23:22.318254 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:23:22.330137 22707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.319557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42400 (local address 127.1.235.190:35441)
0809 23:23:22.319625 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:22.319627 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:22.319717 (+ 90us) server_negotiation.cc:407] Connection header received
0809 23:23:22.319784 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:22.319785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:22.319794 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:22.319844 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:22.319996 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.320443 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.321145 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.321331 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.321404 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.329876 (+ 8472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:22.329877 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:22.329877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:22.329881 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:22.329893 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:22.329897 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:22.329993 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:22.330055 (+ 62us) server_negotiation.cc:299] Negotiation successful
0809 23:23:22.330064 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 23:23:22.331624 22663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42400:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:23:22.333108 22663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:23:22.338644 23196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.335122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:46069 (local address 127.0.0.1:42388)
0809 23:23:22.335438 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:22.335449 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:22.335501 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:22.335796 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:22.335799 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:22.335801 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:22.335872 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:22.335874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.336701 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.336702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:22.337594 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:22.337596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.338390 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.338391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:22.338462 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.338473 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 23:23:22.338545 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 23:23:22.338583 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":82,"threads_started":1}
I20260809 23:23:22.338660 23197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.335271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42388 (local address 127.1.235.129:46069)
0809 23:23:22.335609 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:22.335613 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:22.335622 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:23:22.335658 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:22.335659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:22.335673 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:22.335802 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:22.335929 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.336611 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.337674 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.338314 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.338379 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.338458 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:22.338555 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 23:23:22.338590 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":74,"threads_started":1}
I20260809 23:23:22.339224 23194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.335121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:39865 (local address 127.0.0.1:52798)
0809 23:23:22.335283 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:22.335338 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:22.335400 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:22.335963 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:22.335963 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:22.335965 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:22.335998 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:22.335999 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.337142 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.337143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:22.338036 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:22.338039 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.339039 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.339040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:22.339092 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.339095 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:23:22.339131 (+ 36us) client_negotiation.cc:240] Negotiation successful
0809 23:23:22.339163 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":72,"threads_started":1}
I20260809 23:23:22.339246 23198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.335368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52798 (local address 127.1.235.131:39865)
0809 23:23:22.335610 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:22.335614 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:22.335624 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:23:22.335657 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:22.335659 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:22.335671 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:22.336066 (+ 395us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:22.336111 (+ 45us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.337064 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.338094 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.338975 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.339043 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.339124 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:22.339145 (+ 21us) server_negotiation.cc:299] Negotiation successful
0809 23:23:22.339177 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":95,"threads_started":1}
I20260809 23:23:22.339356 22799 tablet_service.cc:1467] Processing CreateTablet for tablet 3eec4dbb46894340869649eda4c888f1 (DEFAULT_TABLE table=test-table [id=6a363c5da9c64e8699289cf9f8f3d0b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:22.339704 22799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3eec4dbb46894340869649eda4c888f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:22.340003 23199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.335389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49560 (local address 127.1.235.130:34259)
0809 23:23:22.335556 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:22.335561 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:22.335588 (+ 27us) server_negotiation.cc:407] Connection header received
0809 23:23:22.335653 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:22.335655 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:22.335671 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:22.335810 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:22.336054 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.337065 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.339007 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.339700 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.339753 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.339848 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:22.339919 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 23:23:22.339947 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":96,"threads_started":1}
I20260809 23:23:22.339993 23195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.335154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:34259 (local address 127.0.0.1:49560)
0809 23:23:22.335534 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:22.335543 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:22.335578 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:22.335947 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:22.335948 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:22.335950 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:22.335979 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:22.335980 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.338112 (+ 2132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.338112 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:22.338908 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:22.338911 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.339777 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.339778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:22.339837 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.339841 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:23:22.339899 (+ 58us) client_negotiation.cc:240] Negotiation successful
0809 23:23:22.339933 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":80,"threads_started":1}
I20260809 23:23:22.342585 22955 tablet_service.cc:1467] Processing CreateTablet for tablet 3eec4dbb46894340869649eda4c888f1 (DEFAULT_TABLE table=test-table [id=6a363c5da9c64e8699289cf9f8f3d0b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:22.342613 23108 tablet_service.cc:1467] Processing CreateTablet for tablet 3eec4dbb46894340869649eda4c888f1 (DEFAULT_TABLE table=test-table [id=6a363c5da9c64e8699289cf9f8f3d0b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:22.342903 22955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3eec4dbb46894340869649eda4c888f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:22.342938 23108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3eec4dbb46894340869649eda4c888f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:22.345068 23200 tablet_bootstrap.cc:492] T 3eec4dbb46894340869649eda4c888f1 P 0fe0c592a3a94ac7b77c61ca1ebc3af5: Bootstrap starting.
I20260809 23:23:22.345552 23202 tablet_bootstrap.cc:492] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f: Bootstrap starting.
I20260809 23:23:22.345754 23200 tablet_bootstrap.cc:654] T 3eec4dbb46894340869649eda4c888f1 P 0fe0c592a3a94ac7b77c61ca1ebc3af5: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:22.346108 23200 log.cc:824] T 3eec4dbb46894340869649eda4c888f1 P 0fe0c592a3a94ac7b77c61ca1ebc3af5: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:22.346172 23202 tablet_bootstrap.cc:654] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:22.346462 23201 tablet_bootstrap.cc:492] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33: Bootstrap starting.
I20260809 23:23:22.346457 23202 log.cc:824] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:22.346900 23200 tablet_bootstrap.cc:492] T 3eec4dbb46894340869649eda4c888f1 P 0fe0c592a3a94ac7b77c61ca1ebc3af5: No bootstrap required, opened a new log
I20260809 23:23:22.346966 23200 ts_tablet_manager.cc:1397] T 3eec4dbb46894340869649eda4c888f1 P 0fe0c592a3a94ac7b77c61ca1ebc3af5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:23:22.347005 23201 tablet_bootstrap.cc:654] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:22.347157 23202 tablet_bootstrap.cc:492] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f: No bootstrap required, opened a new log
I20260809 23:23:22.347218 23202 ts_tablet_manager.cc:1397] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 23:23:22.347297 23201 log.cc:824] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:22.348090 23201 tablet_bootstrap.cc:492] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33: No bootstrap required, opened a new log
I20260809 23:23:22.348150 23201 ts_tablet_manager.cc:1397] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:23:22.349149 23200 raft_consensus.cc:348] T 3eec4dbb46894340869649eda4c888f1 P 0fe0c592a3a94ac7b77c61ca1ebc3af5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe0c592a3a94ac7b77c61ca1ebc3af5" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46069 } } peers { permanent_uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 39865 } } peers { permanent_uuid: "3518d47218ab4c35be85d74c08c29f33" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34259 } }
I20260809 23:23:22.349287 23200 raft_consensus.cc:374] T 3eec4dbb46894340869649eda4c888f1 P 0fe0c592a3a94ac7b77c61ca1ebc3af5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:22.349326 23200 raft_consensus.cc:729] T 3eec4dbb46894340869649eda4c888f1 P 0fe0c592a3a94ac7b77c61ca1ebc3af5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fe0c592a3a94ac7b77c61ca1ebc3af5, State: Initialized, Role: FOLLOWER
I20260809 23:23:22.349426 23200 consensus_queue.cc:260] T 3eec4dbb46894340869649eda4c888f1 P 0fe0c592a3a94ac7b77c61ca1ebc3af5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe0c592a3a94ac7b77c61ca1ebc3af5" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46069 } } peers { permanent_uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 39865 } } peers { permanent_uuid: "3518d47218ab4c35be85d74c08c29f33" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34259 } }
I20260809 23:23:22.349565 23202 raft_consensus.cc:348] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe0c592a3a94ac7b77c61ca1ebc3af5" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46069 } } peers { permanent_uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 39865 } } peers { permanent_uuid: "3518d47218ab4c35be85d74c08c29f33" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34259 } }
I20260809 23:23:22.349696 23200 ts_tablet_manager.cc:1428] T 3eec4dbb46894340869649eda4c888f1 P 0fe0c592a3a94ac7b77c61ca1ebc3af5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:23:22.349726 22875 heartbeater.cc:503] Master 127.1.235.190:35441 was elected leader, sending a full tablet report...
I20260809 23:23:22.349722 23202 raft_consensus.cc:374] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:22.349771 23202 raft_consensus.cc:729] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f80ce22cfcdd4fad9e695577ac2f3e9f, State: Initialized, Role: FOLLOWER
I20260809 23:23:22.349907 23202 consensus_queue.cc:260] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe0c592a3a94ac7b77c61ca1ebc3af5" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46069 } } peers { permanent_uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 39865 } } peers { permanent_uuid: "3518d47218ab4c35be85d74c08c29f33" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34259 } }
I20260809 23:23:22.350172 23202 ts_tablet_manager.cc:1428] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 23:23:22.350210 23185 heartbeater.cc:503] Master 127.1.235.190:35441 was elected leader, sending a full tablet report...
I20260809 23:23:22.350975 23201 raft_consensus.cc:348] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe0c592a3a94ac7b77c61ca1ebc3af5" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46069 } } peers { permanent_uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 39865 } } peers { permanent_uuid: "3518d47218ab4c35be85d74c08c29f33" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34259 } }
I20260809 23:23:22.351128 23201 raft_consensus.cc:374] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:22.351169 23201 raft_consensus.cc:729] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3518d47218ab4c35be85d74c08c29f33, State: Initialized, Role: FOLLOWER
I20260809 23:23:22.351266 23201 consensus_queue.cc:260] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe0c592a3a94ac7b77c61ca1ebc3af5" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46069 } } peers { permanent_uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 39865 } } peers { permanent_uuid: "3518d47218ab4c35be85d74c08c29f33" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34259 } }
I20260809 23:23:22.351449 23201 ts_tablet_manager.cc:1428] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:23:22.351512 23035 heartbeater.cc:503] Master 127.1.235.190:35441 was elected leader, sending a full tablet report...
I20260809 23:23:22.403404 23208 raft_consensus.cc:482] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:23:22.403503 23208 raft_consensus.cc:504] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe0c592a3a94ac7b77c61ca1ebc3af5" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46069 } } peers { permanent_uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 39865 } } peers { permanent_uuid: "3518d47218ab4c35be85d74c08c29f33" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34259 } }
I20260809 23:23:22.403779 23208 leader_election.cc:288] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fe0c592a3a94ac7b77c61ca1ebc3af5 (127.1.235.129:46069), 3518d47218ab4c35be85d74c08c29f33 (127.1.235.130:34259)
I20260809 23:23:22.406522 23197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.404081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:57703 (local address 127.1.235.129:46069)
0809 23:23:22.404126 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:22.404128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:22.404137 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:23:22.404170 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:22.404171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:22.404180 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:22.404258 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:22.404448 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.404935 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.405843 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.406179 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.406260 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.406268 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:22.406425 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 23:23:22.406461 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 23:23:22.406522 23188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.403952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:46069 (local address 127.1.235.131:57703)
0809 23:23:22.403998 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:22.404012 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:22.404067 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:22.404280 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:22.404281 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:22.404284 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:22.404368 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:22.404369 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.405018 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.405019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:22.405710 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:22.405712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.406269 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.406271 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:22.406340 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.406342 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:23:22.406406 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 23:23:22.406455 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260809 23:23:22.406693 23199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.404015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:52985 (local address 127.1.235.130:34259)
0809 23:23:22.404057 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:22.404059 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:22.404217 (+ 158us) server_negotiation.cc:407] Connection header received
0809 23:23:22.404288 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:22.404289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:22.404305 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:22.404375 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:22.404531 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.404978 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.405924 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.406242 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.406336 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.406343 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:22.406533 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 23:23:22.406593 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:23:22.406859 22822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3eec4dbb46894340869649eda4c888f1" candidate_uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe0c592a3a94ac7b77c61ca1ebc3af5" is_pre_election: true
I20260809 23:23:22.406920 23210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.403952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:34259 (local address 127.1.235.131:52985)
0809 23:23:22.404138 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:22.404155 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:22.404222 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:22.404378 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:22.404379 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:22.404380 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:22.404462 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:22.404463 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.405065 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.405066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:22.405795 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:22.405797 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.406338 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.406339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:22.406446 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.406450 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:23:22.406807 (+ 357us) client_negotiation.cc:240] Negotiation successful
0809 23:23:22.406843 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":12,"thread_start_us":122,"threads_started":1}
I20260809 23:23:22.407017 22822 raft_consensus.cc:2454] T 3eec4dbb46894340869649eda4c888f1 P 0fe0c592a3a94ac7b77c61ca1ebc3af5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f80ce22cfcdd4fad9e695577ac2f3e9f in term 0.
I20260809 23:23:22.407195 22979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3eec4dbb46894340869649eda4c888f1" candidate_uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3518d47218ab4c35be85d74c08c29f33" is_pre_election: true
I20260809 23:23:22.407322 23060 leader_election.cc:302] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe0c592a3a94ac7b77c61ca1ebc3af5, f80ce22cfcdd4fad9e695577ac2f3e9f; no voters:
I20260809 23:23:22.407349 22979 raft_consensus.cc:2454] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f80ce22cfcdd4fad9e695577ac2f3e9f in term 0.
I20260809 23:23:22.407472 23208 raft_consensus.cc:2781] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:23:22.407523 23208 raft_consensus.cc:482] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:23:22.407552 23208 raft_consensus.cc:3037] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:22.408195 23208 raft_consensus.cc:504] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe0c592a3a94ac7b77c61ca1ebc3af5" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46069 } } peers { permanent_uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 39865 } } peers { permanent_uuid: "3518d47218ab4c35be85d74c08c29f33" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34259 } }
I20260809 23:23:22.408324 23208 leader_election.cc:288] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [CANDIDATE]: Term 1 election: Requested vote from peers 0fe0c592a3a94ac7b77c61ca1ebc3af5 (127.1.235.129:46069), 3518d47218ab4c35be85d74c08c29f33 (127.1.235.130:34259)
I20260809 23:23:22.408512 22979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3eec4dbb46894340869649eda4c888f1" candidate_uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3518d47218ab4c35be85d74c08c29f33"
I20260809 23:23:22.408517 22822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3eec4dbb46894340869649eda4c888f1" candidate_uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fe0c592a3a94ac7b77c61ca1ebc3af5"
I20260809 23:23:22.408579 22979 raft_consensus.cc:3037] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:22.408601 22822 raft_consensus.cc:3037] T 3eec4dbb46894340869649eda4c888f1 P 0fe0c592a3a94ac7b77c61ca1ebc3af5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:22.409345 22822 raft_consensus.cc:2454] T 3eec4dbb46894340869649eda4c888f1 P 0fe0c592a3a94ac7b77c61ca1ebc3af5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f80ce22cfcdd4fad9e695577ac2f3e9f in term 1.
I20260809 23:23:22.409389 22979 raft_consensus.cc:2454] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f80ce22cfcdd4fad9e695577ac2f3e9f in term 1.
I20260809 23:23:22.409502 23060 leader_election.cc:302] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fe0c592a3a94ac7b77c61ca1ebc3af5, f80ce22cfcdd4fad9e695577ac2f3e9f; no voters:
I20260809 23:23:22.409587 23208 raft_consensus.cc:2781] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:22.409721 23208 raft_consensus.cc:686] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [term 1 LEADER]: Becoming Leader. State: Replica: f80ce22cfcdd4fad9e695577ac2f3e9f, State: Running, Role: LEADER
I20260809 23:23:22.409837 23208 consensus_queue.cc:237] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe0c592a3a94ac7b77c61ca1ebc3af5" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46069 } } peers { permanent_uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 39865 } } peers { permanent_uuid: "3518d47218ab4c35be85d74c08c29f33" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34259 } }
I20260809 23:23:22.410573 22663 catalog_manager.cc:5495] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f reported cstate change: term changed from 0 to 1, leader changed from <none> to f80ce22cfcdd4fad9e695577ac2f3e9f (127.1.235.131). New cstate: current_term: 1 leader_uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fe0c592a3a94ac7b77c61ca1ebc3af5" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f80ce22cfcdd4fad9e695577ac2f3e9f" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 39865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3518d47218ab4c35be85d74c08c29f33" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34259 } health_report { overall_health: UNKNOWN } } }
I20260809 23:23:22.431756 23198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.429698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52812 (local address 127.1.235.131:39865)
0809 23:23:22.429753 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:22.429754 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:22.429761 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:23:22.429845 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:22.429846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:22.429863 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:22.429934 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:23:22.430042 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.430427 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.431086 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:22.431248 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:22.431297 (+ 49us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:22.431437 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:23:22.431507 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:23:22.431571 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:22.431603 (+ 32us) server_negotiation.cc:299] Negotiation successful
0809 23:23:22.431619 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 23:23:22.433591 22822 raft_consensus.cc:1261] T 3eec4dbb46894340869649eda4c888f1 P 0fe0c592a3a94ac7b77c61ca1ebc3af5 [term 1 FOLLOWER]: Refusing update from remote peer f80ce22cfcdd4fad9e695577ac2f3e9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:23:22.433590 22979 raft_consensus.cc:1261] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33 [term 1 FOLLOWER]: Refusing update from remote peer f80ce22cfcdd4fad9e695577ac2f3e9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:23:22.433985 23211 consensus_queue.cc:1035] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3518d47218ab4c35be85d74c08c29f33" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34259 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:23:22.434119 23208 consensus_queue.cc:1035] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fe0c592a3a94ac7b77c61ca1ebc3af5" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 46069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:23:22.437090 23214 mvcc.cc:205] Tried to move back new op lower bound from 7316757718764990464 to 7316757718671306752. Current Snapshot: MvccSnapshot[applied={T|T < 7316757718764990464 or (T in {7316757718764990464})}]
I20260809 23:23:22.437635 23215 mvcc.cc:205] Tried to move back new op lower bound from 7316757718764990464 to 7316757718671306752. Current Snapshot: MvccSnapshot[applied={T|T < 7316757718764990464}]
I20260809 23:23:22.438921 22662 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:23:22.439021 22662 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:23:22.439749 22662 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 377a5103d76d4135b57492de27e4efaa: Sending DeleteTablet for 3 replicas of tablet 3eec4dbb46894340869649eda4c888f1
I20260809 23:23:22.440060 22799 tablet_service.cc:1514] Processing DeleteTablet for tablet 3eec4dbb46894340869649eda4c888f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:22 UTC) from {username='slave'} at 127.0.0.1:42388
I20260809 23:23:22.440060 23108 tablet_service.cc:1514] Processing DeleteTablet for tablet 3eec4dbb46894340869649eda4c888f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:22 UTC) from {username='slave'} at 127.0.0.1:52798
I20260809 23:23:22.440236 22955 tablet_service.cc:1514] Processing DeleteTablet for tablet 3eec4dbb46894340869649eda4c888f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:22 UTC) from {username='slave'} at 127.0.0.1:49560
I20260809 23:23:22.440328 23227 tablet_replica.cc:330] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f: stopping tablet replica
I20260809 23:23:22.440420 23227 raft_consensus.cc:2229] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:23:22.440515 23227 raft_consensus.cc:2258] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:23:22.440619 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 22729
I20260809 23:23:22.442400 23227 ts_tablet_manager.cc:1905] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:23:22.444135 23227 ts_tablet_manager.cc:1918] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:23:22.444227 23227 log.cc:1196] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/3eec4dbb46894340869649eda4c888f1
I20260809 23:23:22.444587 23227 ts_tablet_manager.cc:1939] T 3eec4dbb46894340869649eda4c888f1 P f80ce22cfcdd4fad9e695577ac2f3e9f: Deleting consensus metadata
I20260809 23:23:22.440519 23228 tablet_replica.cc:330] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33: stopping tablet replica
I20260809 23:23:22.445012 22645 catalog_manager.cc:4841] TS f80ce22cfcdd4fad9e695577ac2f3e9f (127.1.235.131:39865): tablet 3eec4dbb46894340869649eda4c888f1 (table test-table [id=6a363c5da9c64e8699289cf9f8f3d0b2]) successfully deleted
I20260809 23:23:22.445055 23228 raft_consensus.cc:2229] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:23:22.445178 23228 raft_consensus.cc:2258] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:23:22.445709 23228 ts_tablet_manager.cc:1905] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:23:22.447139 23228 ts_tablet_manager.cc:1918] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:23:22.447194 23228 log.cc:1196] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/3eec4dbb46894340869649eda4c888f1
I20260809 23:23:22.447427 23228 ts_tablet_manager.cc:1939] T 3eec4dbb46894340869649eda4c888f1 P 3518d47218ab4c35be85d74c08c29f33: Deleting consensus metadata
I20260809 23:23:22.447906 22647 catalog_manager.cc:4841] TS 3518d47218ab4c35be85d74c08c29f33 (127.1.235.130:34259): tablet 3eec4dbb46894340869649eda4c888f1 (table test-table [id=6a363c5da9c64e8699289cf9f8f3d0b2]) successfully deleted
W20260809 23:23:22.449736 22648 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.235.129:46069 (error 108)
I20260809 23:23:22.450191 23196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:22.450029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:46069 (local address 127.0.0.1:42404)
0809 23:23:22.450119 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:22.450155 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.129:46069: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 23:23:22.450335 22648 catalog_manager.cc:4584] TS 0fe0c592a3a94ac7b77c61ca1ebc3af5 (127.1.235.129:46069): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3eec4dbb46894340869649eda4c888f1: Network error: Client connection negotiation failed: client connection to 127.1.235.129:46069: connect: Connection refused (error 111)
I20260809 23:23:22.450389 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 22879
I20260809 23:23:22.460106 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 23040
I20260809 23:23:22.467018 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 22630
2026-08-09T23:23:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (701 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:22 dist-test-slave-6nmv krb5kdc[23232](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:22 dist-test-slave-6nmv krb5kdc[23232](info): set up 2 sockets
Aug 09 23:23:22 dist-test-slave-6nmv krb5kdc[23232](info): commencing operation
krb5kdc: starting...
W20260809 23:23:23.493490 1966 mini_kdc.cc:121] Time spent starting KDC: real 0.997s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:23 dist-test-slave-6nmv krb5kdc[23232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:23:23.600416 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:35765
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:35765
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:23.675840 23248 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:23.676066 23248 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:23.676086 23248 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:23.677098 23248 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:23.677141 23248 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:23.677155 23248 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:23.677209 23248 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:23.677234 23248 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:23.678593 23248 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:35765
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:35765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23248
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:23.678834 23248 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:23.679060 23248 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:23.683425 23254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:23.683451 23256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:23.683516 23253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:23.683672 23248 server_base.cc:1034] running on GCE node
I20260809 23:23:23.683923 23248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:23.684245 23248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:23.685407 23248 hybrid_clock.cc:648] HybridClock initialized: now 1786317803685396 us; error 31 us; skew 500 ppm
Aug 09 23:23:23 dist-test-slave-6nmv krb5kdc[23232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317803, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:23.690871 23248 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:23:23.691345 23248 webserver.cc:460] Webserver started at http://127.1.235.190:37197/ using document root <none> and password file <none>
I20260809 23:23:23.691551 23248 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:23.691625 23248 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:23.691797 23248 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:23.692763 23248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "dc709312bd174bc9b14bf42d802c7c46"
format_stamp: "Formatted at 2026-08-09 23:23:23 on dist-test-slave-6nmv"
server_key: "43b7ed0b63ebaf663b06c7d5e811ee75"
server_key_iv: "338bca53ccdd67afdb6d0a40740e3b31"
server_key_version: "encryptionkey@0"
I20260809 23:23:23.693207 23248 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "dc709312bd174bc9b14bf42d802c7c46"
format_stamp: "Formatted at 2026-08-09 23:23:23 on dist-test-slave-6nmv"
server_key: "43b7ed0b63ebaf663b06c7d5e811ee75"
server_key_iv: "338bca53ccdd67afdb6d0a40740e3b31"
server_key_version: "encryptionkey@0"
I20260809 23:23:23.694741 23248 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:23:23.695457 23264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:23.695629 23248 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:23.695722 23248 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "dc709312bd174bc9b14bf42d802c7c46"
format_stamp: "Formatted at 2026-08-09 23:23:23 on dist-test-slave-6nmv"
server_key: "43b7ed0b63ebaf663b06c7d5e811ee75"
server_key_iv: "338bca53ccdd67afdb6d0a40740e3b31"
server_key_version: "encryptionkey@0"
I20260809 23:23:23.695794 23248 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:23.711058 23248 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:23.712755 23248 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:23.712931 23248 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:23.716936 23248 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:35765
I20260809 23:23:23.717247 23327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:35765 every 8 connection(s)
I20260809 23:23:23.717252 23248 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:23.717986 23328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:23.720016 23328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46: Bootstrap starting.
I20260809 23:23:23.720511 23328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:23.720757 23328 log.cc:824] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:23.721401 23328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46: No bootstrap required, opened a new log
I20260809 23:23:23.722883 23328 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc709312bd174bc9b14bf42d802c7c46" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35765 } }
I20260809 23:23:23.723009 23328 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:23.723035 23328 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc709312bd174bc9b14bf42d802c7c46, State: Initialized, Role: FOLLOWER
I20260809 23:23:23.723134 23328 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc709312bd174bc9b14bf42d802c7c46" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35765 } }
I20260809 23:23:23.723183 23328 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:23.723205 23328 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:23.723238 23328 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:23.723750 23328 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc709312bd174bc9b14bf42d802c7c46" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35765 } }
I20260809 23:23:23.723838 23328 leader_election.cc:302] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc709312bd174bc9b14bf42d802c7c46; no voters:
I20260809 23:23:23.723969 23328 leader_election.cc:288] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:23.724045 23331 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:23.724239 23331 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [term 1 LEADER]: Becoming Leader. State: Replica: dc709312bd174bc9b14bf42d802c7c46, State: Running, Role: LEADER
I20260809 23:23:23.724268 23328 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:23.724328 23331 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc709312bd174bc9b14bf42d802c7c46" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35765 } }
I20260809 23:23:23.724720 23332 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc709312bd174bc9b14bf42d802c7c46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc709312bd174bc9b14bf42d802c7c46" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35765 } } }
I20260809 23:23:23.724764 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 23248
I20260809 23:23:23.724807 23332 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:23.724829 23333 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc709312bd174bc9b14bf42d802c7c46. Latest consensus state: current_term: 1 leader_uuid: "dc709312bd174bc9b14bf42d802c7c46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc709312bd174bc9b14bf42d802c7c46" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 35765 } } }
I20260809 23:23:23.724879 23333 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:23.724900 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:23.725134 1966 external_mini_cluster.cc:1428] Setting key 699dc72149c1854c112cedffc23bc45f
W20260809 23:23:23.726399 23350 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 23:23:23.726468 23350 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:23:23.726518 23339 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:23.726642 23339 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:23.727942 23339 catalog_manager.cc:1347] Generated new cluster ID: b1072ccce506462bb969382fa0bc0fdb
I20260809 23:23:23.727998 23339 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 23:23:23 dist-test-slave-6nmv krb5kdc[23232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:23.734721 23349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:23.725568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53986 (local address 127.1.235.190:35765)
0809 23:23:23.725694 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:23.725703 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:23.725902 (+ 199us) server_negotiation.cc:407] Connection header received
0809 23:23:23.726069 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:23.726074 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:23.726111 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:23.726252 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:23.727015 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:23.728322 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:23.729020 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:23.729396 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:23.729504 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:23.731628 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:23.731632 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:23.731632 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:23.731643 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:23.733198 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:23.733598 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:23.733601 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:23.733601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:23.733700 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:23.733944 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:23.733945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:23.733945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:23.734163 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:23.734331 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:23.734417 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 23:23:23.734574 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":72,"threads_started":1}
I20260809 23:23:23.735788 23339 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:23.736215 23339 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:23.739331 23339 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46: Generated new TSK 0
I20260809 23:23:23.739473 23339 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.1.235.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
Entry for principal kudu/127.1.235.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab.
I20260809 23:23:23.768430 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:35765
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:23.843773 23355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:23.844003 23355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:23.844043 23355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:23.845122 23355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:23.845191 23355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:23.845235 23355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:23:23.846652 23355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.129.keytab
--principal=kudu/127.1.235.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:35765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:23.846901 23355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:23.847116 23355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 23:23:23.852108 23355 server_base.cc:1034] running on GCE node
W20260809 23:23:23.852097 23366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:23.852100 23363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:23.852283 23362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:23.852492 23355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:23.852715 23355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:23.853912 23355 hybrid_clock.cc:648] HybridClock initialized: now 1786317803853895 us; error 29 us; skew 500 ppm
Aug 09 23:23:23 dist-test-slave-6nmv krb5kdc[23232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317803, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:23.856341 23355 init.cc:377] Logged in from keytab as kudu/127.1.235.129@KRBTEST.COM (short username kudu)
I20260809 23:23:23.856737 23355 webserver.cc:460] Webserver started at http://127.1.235.129:44113/ using document root <none> and password file <none>
I20260809 23:23:23.856956 23355 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:23.857021 23355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:23.857147 23355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:23.858136 23355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "e7156956ce264d35ab96b09bc6d49753"
format_stamp: "Formatted at 2026-08-09 23:23:23 on dist-test-slave-6nmv"
server_key: "9a034002cc5592c2f3f0da3eda527cd5"
server_key_iv: "8ccc90cd30c34718100ba0dece02df93"
server_key_version: "encryptionkey@0"
I20260809 23:23:23.858469 23355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "e7156956ce264d35ab96b09bc6d49753"
format_stamp: "Formatted at 2026-08-09 23:23:23 on dist-test-slave-6nmv"
server_key: "9a034002cc5592c2f3f0da3eda527cd5"
server_key_iv: "8ccc90cd30c34718100ba0dece02df93"
server_key_version: "encryptionkey@0"
I20260809 23:23:23.859658 23355 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:23:23.860368 23373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:23.860543 23355 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:23.860635 23355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "e7156956ce264d35ab96b09bc6d49753"
format_stamp: "Formatted at 2026-08-09 23:23:23 on dist-test-slave-6nmv"
server_key: "9a034002cc5592c2f3f0da3eda527cd5"
server_key_iv: "8ccc90cd30c34718100ba0dece02df93"
server_key_version: "encryptionkey@0"
I20260809 23:23:23.860713 23355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:23.871407 23355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:23.873230 23355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:23.873430 23355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:23.873646 23355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:23.874011 23355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:23.874066 23355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:23.874105 23355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:23.874132 23355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:23.879516 23355 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:40149
I20260809 23:23:23.879571 23494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:40149 every 8 connection(s)
I20260809 23:23:23.879863 23355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:23:23.883291 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 23355
I20260809 23:23:23.883447 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:23:23.883647 1966 external_mini_cluster.cc:1428] Setting key b0296a28e67fb8e8d9daf014f07856ff
Aug 09 23:23:23 dist-test-slave-6nmv krb5kdc[23232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317803, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.129@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:23.889937 23349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:23.880547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:50603 (local address 127.1.235.190:35765)
0809 23:23:23.880628 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:23.880631 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:23.880882 (+ 251us) server_negotiation.cc:407] Connection header received
0809 23:23:23.881340 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:23.881342 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:23.881357 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:23.881402 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:23.882358 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:23.882821 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:23.883981 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:23.884247 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:23.884317 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:23.886657 (+ 2340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:23.886659 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:23.886659 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:23.886667 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:23.888519 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:23.888893 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:23.888894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:23.888894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:23.888956 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:23.889255 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:23.889256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:23.889256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:23.889411 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:23.889483 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:23.889723 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 23:23:23.889831 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 23:23:23.890007 23497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:23.880508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:35765 (local address 127.1.235.129:50603)
0809 23:23:23.880707 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:23.880752 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:23.881219 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:23.881493 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:23.881497 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:23.882089 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:23.882254 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:23.882259 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:23.882916 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:23.882917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:23.883868 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:23.883871 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:23.884343 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:23.884344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:23.884515 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:23.884975 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:23.884981 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:23.886568 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:23.888595 (+ 2027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:23.888602 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:23.888603 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:23.888803 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:23.889040 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:23.889041 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:23.889042 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:23.889184 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:23.889479 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:23.889484 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:23.889586 (+ 102us) client_negotiation.cc:769] Sending connection context
0809 23:23:23.889676 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 23:23:23.889783 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":79,"threads_started":1}
I20260809 23:23:23.890509 23495 heartbeater.cc:347] Connected to a master server at 127.1.235.190:35765
I20260809 23:23:23.890607 23495 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:23.890777 23495 heartbeater.cc:511] Master 127.1.235.190:35765 requested a full tablet report, sending...
I20260809 23:23:23.891285 23288 ts_manager.cc:194] Registered new tserver with Master: e7156956ce264d35ab96b09bc6d49753 (127.1.235.129:40149)
I20260809 23:23:23.892202 23288 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.129@KRBTEST.COM'} at 127.1.235.129:50603
WARNING: no policy specified for kudu/127.1.235.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
Entry for principal kudu/127.1.235.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab.
I20260809 23:23:23.908768 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:35765
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:23.983786 23500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:23.984009 23500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:23.984047 23500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:23.985123 23500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:23.985186 23500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:23.985227 23500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:23:23.986538 23500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.130.keytab
--principal=kudu/127.1.235.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:35765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:23.986771 23500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:23.987000 23500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:23.991370 23508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:23.991472 23500 server_base.cc:1034] running on GCE node
W20260809 23:23:23.991345 23510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:23.991390 23507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:23.991793 23500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:23.992035 23500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:23.993173 23500 hybrid_clock.cc:648] HybridClock initialized: now 1786317803993160 us; error 25 us; skew 500 ppm
Aug 09 23:23:23 dist-test-slave-6nmv krb5kdc[23232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317803, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:23.995504 23500 init.cc:377] Logged in from keytab as kudu/127.1.235.130@KRBTEST.COM (short username kudu)
I20260809 23:23:23.995816 23500 webserver.cc:460] Webserver started at http://127.1.235.130:39153/ using document root <none> and password file <none>
I20260809 23:23:23.995960 23500 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:23.995992 23500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:23.996064 23500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:23.996891 23500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "e60a7f92c5c94fba9bb07d8294b59e59"
format_stamp: "Formatted at 2026-08-09 23:23:23 on dist-test-slave-6nmv"
server_key: "b22ce609f80f12c8a36db8bef710fa35"
server_key_iv: "109bd378875c3fb2fd5a31e887cc3b60"
server_key_version: "encryptionkey@0"
I20260809 23:23:23.997144 23500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "e60a7f92c5c94fba9bb07d8294b59e59"
format_stamp: "Formatted at 2026-08-09 23:23:23 on dist-test-slave-6nmv"
server_key: "b22ce609f80f12c8a36db8bef710fa35"
server_key_iv: "109bd378875c3fb2fd5a31e887cc3b60"
server_key_version: "encryptionkey@0"
I20260809 23:23:23.998421 23500 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:23:23.999048 23519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:23.999215 23500 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:23.999277 23500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "e60a7f92c5c94fba9bb07d8294b59e59"
format_stamp: "Formatted at 2026-08-09 23:23:23 on dist-test-slave-6nmv"
server_key: "b22ce609f80f12c8a36db8bef710fa35"
server_key_iv: "109bd378875c3fb2fd5a31e887cc3b60"
server_key_version: "encryptionkey@0"
I20260809 23:23:23.999315 23500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:24.014621 23500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:24.016299 23500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:24.016399 23500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:24.016541 23500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:24.016794 23500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:24.016829 23500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:24.016875 23500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:24.016906 23500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:24.021982 23500 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:44469
I20260809 23:23:24.022027 23653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:44469 every 8 connection(s)
I20260809 23:23:24.022294 23500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:23:24.022904 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 23500
I20260809 23:23:24.023001 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:23:24.023165 1966 external_mini_cluster.cc:1428] Setting key 9806cc23d22538e289479294dd3ad01f
Aug 09 23:23:24 dist-test-slave-6nmv krb5kdc[23232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317803, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.130@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.235.131@KRBTEST.COM; defaulting to no policy
I20260809 23:23:24.032161 23349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.023002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:56001 (local address 127.1.235.190:35765)
0809 23:23:24.023054 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.023056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.023235 (+ 179us) server_negotiation.cc:407] Connection header received
0809 23:23:24.023804 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.023805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.023817 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.023875 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:24.024835 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.025530 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.026927 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.027084 (+ 157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.027146 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.029481 (+ 2335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:24.029483 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:24.029484 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:24.029491 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:24.030871 (+ 1380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:24.031250 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:24.031251 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:24.031251 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:24.031308 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:24.031541 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:24.031542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:24.031542 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:24.031670 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:24.031749 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.031991 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.032076 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260809 23:23:24.032312 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.022966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:35765 (local address 127.1.235.130:56001)
0809 23:23:24.023110 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:24.023145 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:24.023685 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:24.023944 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:24.023949 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:24.024596 (+ 647us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:24.024755 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.024759 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.025622 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.025623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.026831 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.026834 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.027181 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.027182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.027322 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.027747 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:24.027756 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:24.029364 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:24.030965 (+ 1601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:24.030971 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:24.030973 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:24.031181 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:24.031369 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:24.031370 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:24.031371 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:24.031476 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:24.031741 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:24.031747 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:24.031872 (+ 125us) client_negotiation.cc:769] Sending connection context
0809 23:23:24.031972 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 23:23:24.032111 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":74,"threads_started":1}
I20260809 23:23:24.032759 23654 heartbeater.cc:347] Connected to a master server at 127.1.235.190:35765
I20260809 23:23:24.032829 23654 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:24.032956 23654 heartbeater.cc:511] Master 127.1.235.190:35765 requested a full tablet report, sending...
I20260809 23:23:24.033298 23288 ts_manager.cc:194] Registered new tserver with Master: e60a7f92c5c94fba9bb07d8294b59e59 (127.1.235.130:44469)
I20260809 23:23:24.033740 23288 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.130@KRBTEST.COM'} at 127.1.235.130:56001
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
Entry for principal kudu/127.1.235.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab.
I20260809 23:23:24.046555 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:35765
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:24.120800 23660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:24.120960 23660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:24.120980 23660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:24.121946 23660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:24.121975 23660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:24.121997 23660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:23:24.123265 23660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.131.keytab
--principal=kudu/127.1.235.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:35765
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:24.123462 23660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:24.123688 23660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:24.128264 23665 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:24.128402 23660 server_base.cc:1034] running on GCE node
W20260809 23:23:24.128273 23668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:24.128489 23666 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:24.128662 23660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:24.128899 23660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:24.130048 23660 hybrid_clock.cc:648] HybridClock initialized: now 1786317804130036 us; error 27 us; skew 500 ppm
Aug 09 23:23:24 dist-test-slave-6nmv krb5kdc[23232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317804, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:24.132380 23660 init.cc:377] Logged in from keytab as kudu/127.1.235.131@KRBTEST.COM (short username kudu)
I20260809 23:23:24.132719 23660 webserver.cc:460] Webserver started at http://127.1.235.131:42139/ using document root <none> and password file <none>
I20260809 23:23:24.132884 23660 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:24.132920 23660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:24.132997 23660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:24.133973 23660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "3ad43efe8cd6412094d8d490c43bd19d"
format_stamp: "Formatted at 2026-08-09 23:23:24 on dist-test-slave-6nmv"
server_key: "8e5b1601d3832d40363e8e5f37f375ef"
server_key_iv: "917e82e764ea77e49c0336cc2bc6a55e"
server_key_version: "encryptionkey@0"
I20260809 23:23:24.134265 23660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "3ad43efe8cd6412094d8d490c43bd19d"
format_stamp: "Formatted at 2026-08-09 23:23:24 on dist-test-slave-6nmv"
server_key: "8e5b1601d3832d40363e8e5f37f375ef"
server_key_iv: "917e82e764ea77e49c0336cc2bc6a55e"
server_key_version: "encryptionkey@0"
I20260809 23:23:24.135428 23660 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:23:24.136003 23678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:24.136145 23660 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:23:24.136229 23660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "3ad43efe8cd6412094d8d490c43bd19d"
format_stamp: "Formatted at 2026-08-09 23:23:24 on dist-test-slave-6nmv"
server_key: "8e5b1601d3832d40363e8e5f37f375ef"
server_key_iv: "917e82e764ea77e49c0336cc2bc6a55e"
server_key_version: "encryptionkey@0"
I20260809 23:23:24.136297 23660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:24.157404 23660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:24.159232 23660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:24.159390 23660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:24.159598 23660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:24.159888 23660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:24.159940 23660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:24.159969 23660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:24.159994 23660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:24.165879 23660 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:36383
I20260809 23:23:24.165922 23812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:36383 every 8 connection(s)
I20260809 23:23:24.166218 23660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:23:24.170753 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 23660
I20260809 23:23:24.170862 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:23:24.171054 1966 external_mini_cluster.cc:1428] Setting key a4713c2bf9a9076a1c14a4751dd95fc5
Aug 09 23:23:24 dist-test-slave-6nmv krb5kdc[23232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317804, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.131@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:24.174638 23349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.166859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:42607 (local address 127.1.235.190:35765)
0809 23:23:24.166904 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.166906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.167102 (+ 196us) server_negotiation.cc:407] Connection header received
0809 23:23:24.167530 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.167531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.167542 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.167599 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:24.168404 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.168850 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.169638 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.169802 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.169924 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.171931 (+ 2007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:24.171932 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:24.171933 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:24.171940 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:24.173262 (+ 1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:24.173755 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:24.173756 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:24.173757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:24.173845 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:24.174127 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:24.174128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:24.174128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:24.174231 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:24.174284 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.174524 (+ 240us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.174582 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:23:24.174791 23815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.166815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:35765 (local address 127.1.235.131:42607)
0809 23:23:24.166985 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:24.167022 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:24.167426 (+ 404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:24.167655 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:24.167658 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:24.168178 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:24.168329 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.168333 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.168931 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.168931 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.169567 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.169568 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.169932 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.169932 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.170025 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.170377 (+ 352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:24.170384 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:24.171859 (+ 1475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:24.173381 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:24.173389 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:24.173390 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:24.173611 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:24.173957 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:24.173958 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:24.173958 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:24.174070 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:24.174290 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:24.174295 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:24.174403 (+ 108us) client_negotiation.cc:769] Sending connection context
0809 23:23:24.174483 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 23:23:24.174601 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":99,"threads_started":1}
I20260809 23:23:24.175268 23813 heartbeater.cc:347] Connected to a master server at 127.1.235.190:35765
I20260809 23:23:24.175361 23813 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:24.175513 23813 heartbeater.cc:511] Master 127.1.235.190:35765 requested a full tablet report, sending...
I20260809 23:23:24.175853 23288 ts_manager.cc:194] Registered new tserver with Master: 3ad43efe8cd6412094d8d490c43bd19d (127.1.235.131:36383)
I20260809 23:23:24.176177 23288 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.1.235.131@KRBTEST.COM'} at 127.1.235.131:42607
I20260809 23:23:24.182734 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:23:24.189260 23349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.184100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54000 (local address 127.1.235.190:35765)
0809 23:23:24.184163 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.184165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.184310 (+ 145us) server_negotiation.cc:407] Connection header received
0809 23:23:24.184354 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.184354 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.184366 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.184412 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:24.184936 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.185360 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.186101 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.186263 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.186315 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.187242 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:24.187242 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:24.187243 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:24.187247 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:24.188478 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:24.188727 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:24.188728 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:24.188728 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:24.188770 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:24.188907 (+ 137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:24.188907 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:24.188907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:24.189009 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:24.189069 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.189143 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.189188 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 23:23:24.190688 23288 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54000:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:23:24.192154 23288 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:23:24.197536 23828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.194569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59818 (local address 127.1.235.131:36383)
0809 23:23:24.194699 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.194703 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.194712 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:23:24.194745 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.194746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.194759 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.194861 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:24.194933 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.195640 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.196623 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.197190 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.197261 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.197309 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.197442 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.197472 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":79,"threads_started":1}
I20260809 23:23:24.197531 23823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.194205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:36383 (local address 127.0.0.1:59818)
0809 23:23:24.194485 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:24.194495 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:24.194567 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:24.194856 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:24.194857 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:24.194858 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:24.194886 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.194887 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.195728 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.195729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.196543 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.196545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.197263 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.197264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.197345 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.197356 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 23:23:24.197427 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 23:23:24.197472 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":2,"thread_start_us":102,"threads_started":1}
I20260809 23:23:24.197888 23824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.194174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:40149 (local address 127.0.0.1:49938)
0809 23:23:24.194356 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:24.194418 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:24.194484 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:24.194707 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:24.194709 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:24.194710 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:24.194763 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.194764 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.195648 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.195649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.196790 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.196792 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.197670 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.197671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.197721 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.197723 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:23:24.197758 (+ 35us) client_negotiation.cc:240] Negotiation successful
0809 23:23:24.197790 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":35,"thread_start_us":66,"threads_started":1}
I20260809 23:23:24.197929 23826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.194301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49938 (local address 127.1.235.129:40149)
0809 23:23:24.194485 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.194490 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.194512 (+ 22us) server_negotiation.cc:407] Connection header received
0809 23:23:24.194595 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.194597 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.194610 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.194703 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:24.194814 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.195552 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.196919 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.197539 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.197579 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.197619 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.197788 (+ 169us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.197848 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":84,"threads_started":1}
I20260809 23:23:24.198387 23735 tablet_service.cc:1467] Processing CreateTablet for tablet c96ebb1a657c47778d7f63777037d592 (DEFAULT_TABLE table=test-table [id=464a752fb35644adb4f3435e6e8cd687]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:24.198578 23424 tablet_service.cc:1467] Processing CreateTablet for tablet c96ebb1a657c47778d7f63777037d592 (DEFAULT_TABLE table=test-table [id=464a752fb35644adb4f3435e6e8cd687]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:24.198688 23735 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c96ebb1a657c47778d7f63777037d592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:24.198859 23827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.194425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:44469 (local address 127.0.0.1:40356)
0809 23:23:24.195012 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:24.195021 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:24.195063 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:24.195837 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:24.195838 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:24.195840 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:24.195882 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.195883 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.196930 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.196931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.197842 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.197844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.198670 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.198671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.198725 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.198729 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:23:24.198773 (+ 44us) client_negotiation.cc:240] Negotiation successful
0809 23:23:24.198807 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":64,"threads_started":1}
I20260809 23:23:24.198881 23424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c96ebb1a657c47778d7f63777037d592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:24.199065 23829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.194810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40356 (local address 127.1.235.130:44469)
0809 23:23:24.195715 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.195718 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.195726 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:23:24.195758 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.195760 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.195773 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.195840 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:24.195950 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.196832 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.197927 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.198533 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.198594 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.198637 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.198953 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.198996 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":872,"thread_start_us":78,"threads_started":1}
I20260809 23:23:24.200852 23830 tablet_bootstrap.cc:492] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d: Bootstrap starting.
I20260809 23:23:24.201067 23831 tablet_bootstrap.cc:492] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753: Bootstrap starting.
I20260809 23:23:24.201637 23831 tablet_bootstrap.cc:654] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:24.201663 23830 tablet_bootstrap.cc:654] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:24.201664 23575 tablet_service.cc:1467] Processing CreateTablet for tablet c96ebb1a657c47778d7f63777037d592 (DEFAULT_TABLE table=test-table [id=464a752fb35644adb4f3435e6e8cd687]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:24.201984 23575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c96ebb1a657c47778d7f63777037d592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:24.202179 23831 log.cc:824] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:24.202216 23830 log.cc:824] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:24.202831 23831 tablet_bootstrap.cc:492] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753: No bootstrap required, opened a new log
I20260809 23:23:24.202911 23831 ts_tablet_manager.cc:1397] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260809 23:23:24.204408 23835 tablet_bootstrap.cc:492] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59: Bootstrap starting.
I20260809 23:23:24.204350 23831 raft_consensus.cc:348] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7156956ce264d35ab96b09bc6d49753" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 40149 } } peers { permanent_uuid: "3ad43efe8cd6412094d8d490c43bd19d" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36383 } } peers { permanent_uuid: "e60a7f92c5c94fba9bb07d8294b59e59" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 44469 } }
I20260809 23:23:24.204548 23831 raft_consensus.cc:374] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:24.204607 23831 raft_consensus.cc:729] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7156956ce264d35ab96b09bc6d49753, State: Initialized, Role: FOLLOWER
I20260809 23:23:24.204713 23831 consensus_queue.cc:260] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7156956ce264d35ab96b09bc6d49753" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 40149 } } peers { permanent_uuid: "3ad43efe8cd6412094d8d490c43bd19d" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36383 } } peers { permanent_uuid: "e60a7f92c5c94fba9bb07d8294b59e59" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 44469 } }
I20260809 23:23:24.204933 23830 tablet_bootstrap.cc:492] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d: No bootstrap required, opened a new log
I20260809 23:23:24.204991 23831 ts_tablet_manager.cc:1428] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 23:23:24.205000 23835 tablet_bootstrap.cc:654] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:24.205006 23830 ts_tablet_manager.cc:1397] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260809 23:23:24.205034 23495 heartbeater.cc:503] Master 127.1.235.190:35765 was elected leader, sending a full tablet report...
I20260809 23:23:24.205478 23835 log.cc:824] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:24.206130 23835 tablet_bootstrap.cc:492] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59: No bootstrap required, opened a new log
I20260809 23:23:24.206179 23835 ts_tablet_manager.cc:1397] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:23:24.206579 23830 raft_consensus.cc:348] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7156956ce264d35ab96b09bc6d49753" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 40149 } } peers { permanent_uuid: "3ad43efe8cd6412094d8d490c43bd19d" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36383 } } peers { permanent_uuid: "e60a7f92c5c94fba9bb07d8294b59e59" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 44469 } }
I20260809 23:23:24.206709 23830 raft_consensus.cc:374] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:24.206748 23830 raft_consensus.cc:729] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad43efe8cd6412094d8d490c43bd19d, State: Initialized, Role: FOLLOWER
I20260809 23:23:24.206862 23830 consensus_queue.cc:260] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7156956ce264d35ab96b09bc6d49753" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 40149 } } peers { permanent_uuid: "3ad43efe8cd6412094d8d490c43bd19d" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36383 } } peers { permanent_uuid: "e60a7f92c5c94fba9bb07d8294b59e59" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 44469 } }
I20260809 23:23:24.207113 23830 ts_tablet_manager.cc:1428] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260809 23:23:24.207154 23813 heartbeater.cc:503] Master 127.1.235.190:35765 was elected leader, sending a full tablet report...
I20260809 23:23:24.207660 23835 raft_consensus.cc:348] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7156956ce264d35ab96b09bc6d49753" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 40149 } } peers { permanent_uuid: "3ad43efe8cd6412094d8d490c43bd19d" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36383 } } peers { permanent_uuid: "e60a7f92c5c94fba9bb07d8294b59e59" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 44469 } }
I20260809 23:23:24.207840 23835 raft_consensus.cc:374] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:24.207890 23835 raft_consensus.cc:729] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e60a7f92c5c94fba9bb07d8294b59e59, State: Initialized, Role: FOLLOWER
I20260809 23:23:24.207990 23835 consensus_queue.cc:260] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7156956ce264d35ab96b09bc6d49753" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 40149 } } peers { permanent_uuid: "3ad43efe8cd6412094d8d490c43bd19d" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36383 } } peers { permanent_uuid: "e60a7f92c5c94fba9bb07d8294b59e59" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 44469 } }
I20260809 23:23:24.208226 23835 ts_tablet_manager.cc:1428] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:23:24.208249 23654 heartbeater.cc:503] Master 127.1.235.190:35765 was elected leader, sending a full tablet report...
W20260809 23:23:24.272855 23655 tablet.cc:2369] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 23:23:24.277516 23836 raft_consensus.cc:482] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:23:24.277596 23836 raft_consensus.cc:504] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7156956ce264d35ab96b09bc6d49753" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 40149 } } peers { permanent_uuid: "3ad43efe8cd6412094d8d490c43bd19d" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36383 } } peers { permanent_uuid: "e60a7f92c5c94fba9bb07d8294b59e59" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 44469 } }
I20260809 23:23:24.277856 23836 leader_election.cc:288] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ad43efe8cd6412094d8d490c43bd19d (127.1.235.131:36383), e60a7f92c5c94fba9bb07d8294b59e59 (127.1.235.130:44469)
I20260809 23:23:24.280395 23497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.278070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:36383 (local address 127.1.235.129:48193)
0809 23:23:24.278106 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:24.278116 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:24.278152 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:24.278324 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:24.278325 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:24.278327 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:24.278385 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.278386 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.278958 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.278958 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.279611 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.279613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.280150 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.280151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.280240 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.280243 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:23:24.280300 (+ 57us) client_negotiation.cc:240] Negotiation successful
0809 23:23:24.280335 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260809 23:23:24.280393 23828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.278112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:48193 (local address 127.1.235.131:36383)
0809 23:23:24.278167 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.278169 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.278178 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:23:24.278216 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.278217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.278225 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.278282 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:24.278460 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.278879 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.279698 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.280074 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.280153 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.280161 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.280306 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.280335 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 23:23:24.280618 23842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.278179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:44469 (local address 127.1.235.129:42417)
0809 23:23:24.278306 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:24.278314 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:24.278384 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:24.278524 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:24.278525 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:24.278527 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:24.278586 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.278587 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.279130 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.279131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.279802 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.279804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.280336 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.280337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.280408 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.280410 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:23:24.280466 (+ 56us) client_negotiation.cc:240] Negotiation successful
0809 23:23:24.280525 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":76,"threads_started":1}
I20260809 23:23:24.280712 23829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.278249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:42417 (local address 127.1.235.130:44469)
0809 23:23:24.278285 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.278287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.278375 (+ 88us) server_negotiation.cc:407] Connection header received
0809 23:23:24.278446 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.278446 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.278454 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.278508 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:24.278672 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.279054 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.279920 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.280261 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.280334 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.280341 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.280603 (+ 262us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.280644 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:23:24.280707 23758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c96ebb1a657c47778d7f63777037d592" candidate_uuid: "e7156956ce264d35ab96b09bc6d49753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad43efe8cd6412094d8d490c43bd19d" is_pre_election: true
I20260809 23:23:24.280827 23758 raft_consensus.cc:2454] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7156956ce264d35ab96b09bc6d49753 in term 0.
I20260809 23:23:24.281038 23375 leader_election.cc:302] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad43efe8cd6412094d8d490c43bd19d, e7156956ce264d35ab96b09bc6d49753; no voters:
I20260809 23:23:24.281103 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c96ebb1a657c47778d7f63777037d592" candidate_uuid: "e7156956ce264d35ab96b09bc6d49753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e60a7f92c5c94fba9bb07d8294b59e59" is_pre_election: true
I20260809 23:23:24.281170 23836 raft_consensus.cc:2781] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:23:24.281246 23836 raft_consensus.cc:482] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:23:24.281255 23600 raft_consensus.cc:2454] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7156956ce264d35ab96b09bc6d49753 in term 0.
I20260809 23:23:24.281276 23836 raft_consensus.cc:3037] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:24.281948 23836 raft_consensus.cc:504] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7156956ce264d35ab96b09bc6d49753" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 40149 } } peers { permanent_uuid: "3ad43efe8cd6412094d8d490c43bd19d" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36383 } } peers { permanent_uuid: "e60a7f92c5c94fba9bb07d8294b59e59" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 44469 } }
I20260809 23:23:24.282065 23836 leader_election.cc:288] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [CANDIDATE]: Term 1 election: Requested vote from peers 3ad43efe8cd6412094d8d490c43bd19d (127.1.235.131:36383), e60a7f92c5c94fba9bb07d8294b59e59 (127.1.235.130:44469)
I20260809 23:23:24.282212 23758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c96ebb1a657c47778d7f63777037d592" candidate_uuid: "e7156956ce264d35ab96b09bc6d49753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ad43efe8cd6412094d8d490c43bd19d"
I20260809 23:23:24.282258 23600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c96ebb1a657c47778d7f63777037d592" candidate_uuid: "e7156956ce264d35ab96b09bc6d49753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e60a7f92c5c94fba9bb07d8294b59e59"
I20260809 23:23:24.282295 23758 raft_consensus.cc:3037] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:24.282332 23600 raft_consensus.cc:3037] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:24.283051 23758 raft_consensus.cc:2454] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7156956ce264d35ab96b09bc6d49753 in term 1.
I20260809 23:23:24.283066 23600 raft_consensus.cc:2454] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7156956ce264d35ab96b09bc6d49753 in term 1.
I20260809 23:23:24.283236 23375 leader_election.cc:302] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ad43efe8cd6412094d8d490c43bd19d, e7156956ce264d35ab96b09bc6d49753; no voters:
I20260809 23:23:24.283366 23836 raft_consensus.cc:2781] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:24.283506 23836 raft_consensus.cc:686] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [term 1 LEADER]: Becoming Leader. State: Replica: e7156956ce264d35ab96b09bc6d49753, State: Running, Role: LEADER
I20260809 23:23:24.283604 23836 consensus_queue.cc:237] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7156956ce264d35ab96b09bc6d49753" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 40149 } } peers { permanent_uuid: "3ad43efe8cd6412094d8d490c43bd19d" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36383 } } peers { permanent_uuid: "e60a7f92c5c94fba9bb07d8294b59e59" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 44469 } }
I20260809 23:23:24.284458 23288 catalog_manager.cc:5495] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 reported cstate change: term changed from 0 to 1, leader changed from <none> to e7156956ce264d35ab96b09bc6d49753 (127.1.235.129). New cstate: current_term: 1 leader_uuid: "e7156956ce264d35ab96b09bc6d49753" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7156956ce264d35ab96b09bc6d49753" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 40149 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ad43efe8cd6412094d8d490c43bd19d" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60a7f92c5c94fba9bb07d8294b59e59" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 44469 } health_report { overall_health: UNKNOWN } } }
I20260809 23:23:24.290717 23826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.288458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49940 (local address 127.1.235.129:40149)
0809 23:23:24.288506 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.288507 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.288515 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:23:24.288557 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.288557 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.288569 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.288618 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:23:24.288721 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.289071 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.290189 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.290337 (+ 148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.290386 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.290500 (+ 114us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:23:24.290568 (+ 68us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:23:24.290612 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.290642 (+ 30us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.290653 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260809 23:23:24.292089 23600 raft_consensus.cc:1261] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59 [term 1 FOLLOWER]: Refusing update from remote peer e7156956ce264d35ab96b09bc6d49753: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:23:24.292160 23758 raft_consensus.cc:1261] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d [term 1 FOLLOWER]: Refusing update from remote peer e7156956ce264d35ab96b09bc6d49753: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:23:24.292434 23843 consensus_queue.cc:1035] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad43efe8cd6412094d8d490c43bd19d" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:23:24.292569 23836 consensus_queue.cc:1035] T c96ebb1a657c47778d7f63777037d592 P e7156956ce264d35ab96b09bc6d49753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60a7f92c5c94fba9bb07d8294b59e59" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 44469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:23:24.294467 23846 mvcc.cc:205] Tried to move back new op lower bound from 7316757726378278912 to 7316757726346240000. Current Snapshot: MvccSnapshot[applied={T|T < 7316757726378278912}]
I20260809 23:23:24.295145 23848 mvcc.cc:205] Tried to move back new op lower bound from 7316757726378278912 to 7316757726346240000. Current Snapshot: MvccSnapshot[applied={T|T < 7316757726378278912}]
I20260809 23:23:24.296670 23288 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:23:24.296758 23288 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54000:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:23:24.297477 23288 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dc709312bd174bc9b14bf42d802c7c46: Sending DeleteTablet for 3 replicas of tablet c96ebb1a657c47778d7f63777037d592
I20260809 23:23:24.297828 23424 tablet_service.cc:1514] Processing DeleteTablet for tablet c96ebb1a657c47778d7f63777037d592 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:24 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:49938
I20260809 23:23:24.297832 23735 tablet_service.cc:1514] Processing DeleteTablet for tablet c96ebb1a657c47778d7f63777037d592 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:24 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:59818
I20260809 23:23:24.298048 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 23355
I20260809 23:23:24.298070 23575 tablet_service.cc:1514] Processing DeleteTablet for tablet c96ebb1a657c47778d7f63777037d592 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:24 UTC) from {username='kudu', principal='kudu/127.1.235.190@KRBTEST.COM'} at 127.0.0.1:40356
I20260809 23:23:24.300352 23858 tablet_replica.cc:330] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59: stopping tablet replica
I20260809 23:23:24.300457 23858 raft_consensus.cc:2229] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:23:24.300546 23858 raft_consensus.cc:2258] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:23:24.300920 23858 ts_tablet_manager.cc:1905] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:23:24.301935 23857 tablet_replica.cc:330] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d: stopping tablet replica
I20260809 23:23:24.302039 23857 raft_consensus.cc:2229] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:23:24.302129 23857 raft_consensus.cc:2258] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:23:24.302534 23857 ts_tablet_manager.cc:1905] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:23:24.302673 23858 ts_tablet_manager.cc:1918] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:23:24.302752 23858 log.cc:1196] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/c96ebb1a657c47778d7f63777037d592
I20260809 23:23:24.303050 23858 ts_tablet_manager.cc:1939] T c96ebb1a657c47778d7f63777037d592 P e60a7f92c5c94fba9bb07d8294b59e59: Deleting consensus metadata
I20260809 23:23:24.303478 23271 catalog_manager.cc:4841] TS e60a7f92c5c94fba9bb07d8294b59e59 (127.1.235.130:44469): tablet c96ebb1a657c47778d7f63777037d592 (table test-table [id=464a752fb35644adb4f3435e6e8cd687]) successfully deleted
I20260809 23:23:24.304039 23857 ts_tablet_manager.cc:1918] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:23:24.304106 23857 log.cc:1196] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/c96ebb1a657c47778d7f63777037d592
I20260809 23:23:24.304370 23857 ts_tablet_manager.cc:1939] T c96ebb1a657c47778d7f63777037d592 P 3ad43efe8cd6412094d8d490c43bd19d: Deleting consensus metadata
I20260809 23:23:24.304740 23271 catalog_manager.cc:4841] TS 3ad43efe8cd6412094d8d490c43bd19d (127.1.235.131:36383): tablet c96ebb1a657c47778d7f63777037d592 (table test-table [id=464a752fb35644adb4f3435e6e8cd687]) successfully deleted
W20260809 23:23:24.306874 23265 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.235.129:40149 (error 108)
I20260809 23:23:24.307168 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 23500
I20260809 23:23:24.307309 23827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.307170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:40149 (local address 127.0.0.1:49942)
0809 23:23:24.307222 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:24.307277 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.129:40149: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 23:23:24.307408 23265 catalog_manager.cc:4584] TS e7156956ce264d35ab96b09bc6d49753 (127.1.235.129:40149): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c96ebb1a657c47778d7f63777037d592: Network error: Client connection negotiation failed: client connection to 127.1.235.129:40149: connect: Connection refused (error 111)
I20260809 23:23:24.314781 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 23660
I20260809 23:23:24.323681 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 23248
2026-08-09T23:23:24Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (1848 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T23:23:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:24Z Disabled control of system clock
I20260809 23:23:24.351902 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:43051
--webserver_interface=127.1.235.190
--webserver_port=0
--builtin_ntp_servers=127.1.235.148:32829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:43051
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 23:23:24.425069 23863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:24.425248 23863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:24.425267 23863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:24.426334 23863 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:24.426373 23863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:24.426385 23863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:24.426397 23863 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:24.426414 23863 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:24.427613 23863 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:32829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:43051
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:43051
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23863
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:24.427784 23863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:24.427989 23863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:24.432288 23871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:24.432325 23869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:24.432480 23868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:24.432492 23863 server_base.cc:1034] running on GCE node
I20260809 23:23:24.432761 23863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:24.433079 23863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:24.434232 23863 hybrid_clock.cc:648] HybridClock initialized: now 1786317804434227 us; error 33 us; skew 500 ppm
I20260809 23:23:24.435341 23863 webserver.cc:460] Webserver started at http://127.1.235.190:32777/ using document root <none> and password file <none>
I20260809 23:23:24.435554 23863 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:24.435616 23863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:24.435739 23863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:24.436709 23863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "40b1f387a839443db9c8b6a3a3fdcb3f"
format_stamp: "Formatted at 2026-08-09 23:23:24 on dist-test-slave-6nmv"
server_key: "814e9e59da250d49aefc7a7df1b70237"
server_key_iv: "c12c15d9ee8c44d62fb23605658f47bd"
server_key_version: "encryptionkey@0"
I20260809 23:23:24.437043 23863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "40b1f387a839443db9c8b6a3a3fdcb3f"
format_stamp: "Formatted at 2026-08-09 23:23:24 on dist-test-slave-6nmv"
server_key: "814e9e59da250d49aefc7a7df1b70237"
server_key_iv: "c12c15d9ee8c44d62fb23605658f47bd"
server_key_version: "encryptionkey@0"
I20260809 23:23:24.438354 23863 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:23:24.439009 23877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:24.439194 23863 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:24.439283 23863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "40b1f387a839443db9c8b6a3a3fdcb3f"
format_stamp: "Formatted at 2026-08-09 23:23:24 on dist-test-slave-6nmv"
server_key: "814e9e59da250d49aefc7a7df1b70237"
server_key_iv: "c12c15d9ee8c44d62fb23605658f47bd"
server_key_version: "encryptionkey@0"
I20260809 23:23:24.439356 23863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:24.456815 23863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:24.457147 23863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:24.457296 23863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:24.461268 23863 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:43051
I20260809 23:23:24.461310 23938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:43051 every 8 connection(s)
I20260809 23:23:24.461666 23863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:24.462641 23940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:24.464867 23940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f: Bootstrap starting.
I20260809 23:23:24.465406 23940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:24.465698 23940 log.cc:824] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:24.465852 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 23863
I20260809 23:23:24.465996 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:24.466193 1966 external_mini_cluster.cc:1428] Setting key ab64b473f00f276384d65057db9d281d
I20260809 23:23:24.466440 23940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f: No bootstrap required, opened a new log
I20260809 23:23:24.468091 23940 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40b1f387a839443db9c8b6a3a3fdcb3f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43051 } }
I20260809 23:23:24.468240 23940 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:24.468286 23940 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40b1f387a839443db9c8b6a3a3fdcb3f, State: Initialized, Role: FOLLOWER
I20260809 23:23:24.468406 23940 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40b1f387a839443db9c8b6a3a3fdcb3f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43051 } }
I20260809 23:23:24.468530 23940 raft_consensus.cc:388] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:24.468569 23940 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:24.468614 23940 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:24.469316 23940 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40b1f387a839443db9c8b6a3a3fdcb3f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43051 } }
I20260809 23:23:24.469432 23940 leader_election.cc:302] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40b1f387a839443db9c8b6a3a3fdcb3f; no voters:
I20260809 23:23:24.469616 23940 leader_election.cc:288] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:24.469650 23946 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:24.469750 23946 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [term 1 LEADER]: Becoming Leader. State: Replica: 40b1f387a839443db9c8b6a3a3fdcb3f, State: Running, Role: LEADER
I20260809 23:23:24.469877 23940 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:24.469853 23946 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40b1f387a839443db9c8b6a3a3fdcb3f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43051 } }
I20260809 23:23:24.470451 23946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40b1f387a839443db9c8b6a3a3fdcb3f. Latest consensus state: current_term: 1 leader_uuid: "40b1f387a839443db9c8b6a3a3fdcb3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40b1f387a839443db9c8b6a3a3fdcb3f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43051 } } }
I20260809 23:23:24.470561 23946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:24.470755 23955 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:24.471194 23955 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:24.472313 23947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40b1f387a839443db9c8b6a3a3fdcb3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40b1f387a839443db9c8b6a3a3fdcb3f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43051 } } }
I20260809 23:23:24.472611 23947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:24.473268 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.466652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37540 (local address 127.1.235.190:43051)
0809 23:23:24.466853 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.466861 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.466896 (+ 35us) server_negotiation.cc:407] Connection header received
0809 23:23:24.468085 (+ 1189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.468090 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.468140 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.468268 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:24.468508 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.470226 (+ 1718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.471313 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.471734 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.471861 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.472532 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:24.472536 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:24.472537 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:24.472726 (+ 189us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:24.472765 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:24.472779 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:24.472843 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.472975 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.473049 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":80,"threads_started":1}
I20260809 23:23:24.473685 23955 catalog_manager.cc:1347] Generated new cluster ID: 142e98266bf04375a47e1c7afa97a177
I20260809 23:23:24.473742 23955 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:24.485472 23955 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:24.486045 23955 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:24.495512 23955 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f: Generated new TSK 0
I20260809 23:23:24.495666 23955 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:24.502588 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.129:0
--local_ip_for_outbound_sockets=127.1.235.129
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:43051
--builtin_ntp_servers=127.1.235.148:32829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 23:23:24.576411 23966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:24.576596 23966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:24.576624 23966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:24.577567 23966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:24.577620 23966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:24.577657 23966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.129
I20260809 23:23:24.578837 23966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:32829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.1.235.129
--webserver_port=0
--tserver_master_addrs=127.1.235.190:43051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.129
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:24.579066 23966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:24.579315 23966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:24.584540 23975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:24.584560 23972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:24.584697 23966 server_base.cc:1034] running on GCE node
W20260809 23:23:24.584570 23973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:24.584911 23966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:24.585156 23966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:24.586290 23966 hybrid_clock.cc:648] HybridClock initialized: now 1786317804586275 us; error 30 us; skew 500 ppm
I20260809 23:23:24.587559 23966 webserver.cc:460] Webserver started at http://127.1.235.129:35223/ using document root <none> and password file <none>
I20260809 23:23:24.587780 23966 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:24.587842 23966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:24.587977 23966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:24.588910 23966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-0/data/instance:
uuid: "96f876f471fe44959e187a2dee483964"
format_stamp: "Formatted at 2026-08-09 23:23:24 on dist-test-slave-6nmv"
server_key: "ce030ef1bc35f2b5b310bf3a948b7c2a"
server_key_iv: "79f2b6c44093bf3e45c39cf75cfff5f3"
server_key_version: "encryptionkey@0"
I20260809 23:23:24.589231 23966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance:
uuid: "96f876f471fe44959e187a2dee483964"
format_stamp: "Formatted at 2026-08-09 23:23:24 on dist-test-slave-6nmv"
server_key: "ce030ef1bc35f2b5b310bf3a948b7c2a"
server_key_iv: "79f2b6c44093bf3e45c39cf75cfff5f3"
server_key_version: "encryptionkey@0"
I20260809 23:23:24.590490 23966 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:23:24.591145 23982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:24.591298 23966 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:23:24.591387 23966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-0/wal
uuid: "96f876f471fe44959e187a2dee483964"
format_stamp: "Formatted at 2026-08-09 23:23:24 on dist-test-slave-6nmv"
server_key: "ce030ef1bc35f2b5b310bf3a948b7c2a"
server_key_iv: "79f2b6c44093bf3e45c39cf75cfff5f3"
server_key_version: "encryptionkey@0"
I20260809 23:23:24.591466 23966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:24.612784 23966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:24.613091 23966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:24.613233 23966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:24.613469 23966 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:24.613775 23966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:24.613897 23966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:24.613950 23966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:24.613981 23966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:24.619547 23966 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.129:43625
I20260809 23:23:24.619592 24115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.129:43625 every 8 connection(s)
I20260809 23:23:24.619853 23966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-0/data/info.pb
I20260809 23:23:24.624645 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.620472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.129:50229 (local address 127.1.235.190:43051)
0809 23:23:24.620514 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.620516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.620736 (+ 220us) server_negotiation.cc:407] Connection header received
0809 23:23:24.621224 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.621225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.621239 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.621288 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:24.621936 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.622379 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.623280 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.623501 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.623581 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.624310 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:24.624312 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:24.624313 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:24.624318 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:24.624333 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:24.624337 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:24.624410 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.624543 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.624570 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 23:23:24.624835 24118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.620454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:43051 (local address 127.1.235.129:50229)
0809 23:23:24.620629 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:24.620659 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:24.621127 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:24.621362 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:24.621366 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:24.621381 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:24.621863 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.621868 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.622470 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.622471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.623193 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.623195 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.623589 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.623591 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.623725 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.624175 (+ 450us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:23:24.624176 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:24.624201 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:23:24.624223 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:24.624441 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:24.624451 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:24.624454 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:23:24.624532 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 23:23:24.624629 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":77,"threads_started":1}
I20260809 23:23:24.625315 24116 heartbeater.cc:347] Connected to a master server at 127.1.235.190:43051
I20260809 23:23:24.625412 24116 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:24.625577 24116 heartbeater.cc:511] Master 127.1.235.190:43051 requested a full tablet report, sending...
I20260809 23:23:24.626065 23896 ts_manager.cc:194] Registered new tserver with Master: 96f876f471fe44959e187a2dee483964 (127.1.235.129:43625)
I20260809 23:23:24.626668 23896 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.235.129:50229
I20260809 23:23:24.627645 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 23966
I20260809 23:23:24.627750 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-0/wal/instance
I20260809 23:23:24.627916 1966 external_mini_cluster.cc:1428] Setting key e42924db961fd89f993a9510bea15600
I20260809 23:23:24.628641 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.130:0
--local_ip_for_outbound_sockets=127.1.235.130
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:43051
--builtin_ntp_servers=127.1.235.148:32829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 23:23:24.705265 24119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:24.705439 24119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:24.705459 24119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:24.706393 24119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:24.706427 24119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:24.706451 24119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.130
I20260809 23:23:24.707528 24119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:32829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.1.235.130
--webserver_port=0
--tserver_master_addrs=127.1.235.190:43051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24119
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.130
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:24.707690 24119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:24.707983 24119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:24.712432 24125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:24.712390 24127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:24.712397 24124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:24.712720 24119 server_base.cc:1034] running on GCE node
I20260809 23:23:24.712963 24119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:24.713191 24119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:24.714334 24119 hybrid_clock.cc:648] HybridClock initialized: now 1786317804714305 us; error 43 us; skew 500 ppm
I20260809 23:23:24.715709 24119 webserver.cc:460] Webserver started at http://127.1.235.130:43911/ using document root <none> and password file <none>
I20260809 23:23:24.715973 24119 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:24.716025 24119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:24.716190 24119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:24.717196 24119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/data/instance:
uuid: "2432be4ddf374bafa76520aa4a0036f6"
format_stamp: "Formatted at 2026-08-09 23:23:24 on dist-test-slave-6nmv"
server_key: "de19613f72ff60aefcd43e76b64637ee"
server_key_iv: "4734eeadeeb1111f734b4378aac35bab"
server_key_version: "encryptionkey@0"
I20260809 23:23:24.717617 24119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance:
uuid: "2432be4ddf374bafa76520aa4a0036f6"
format_stamp: "Formatted at 2026-08-09 23:23:24 on dist-test-slave-6nmv"
server_key: "de19613f72ff60aefcd43e76b64637ee"
server_key_iv: "4734eeadeeb1111f734b4378aac35bab"
server_key_version: "encryptionkey@0"
I20260809 23:23:24.718972 24119 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:23:24.719662 24133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:24.719839 24119 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:24.719935 24119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/wal
uuid: "2432be4ddf374bafa76520aa4a0036f6"
format_stamp: "Formatted at 2026-08-09 23:23:24 on dist-test-slave-6nmv"
server_key: "de19613f72ff60aefcd43e76b64637ee"
server_key_iv: "4734eeadeeb1111f734b4378aac35bab"
server_key_version: "encryptionkey@0"
I20260809 23:23:24.720007 24119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:24.757215 24119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:24.757565 24119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:24.757718 24119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:24.758004 24119 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:24.758345 24119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:24.758412 24119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:24.758447 24119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:24.758476 24119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:24.764216 24119 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.130:34421
I20260809 23:23:24.764261 24268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.130:34421 every 8 connection(s)
I20260809 23:23:24.764587 24119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/data/info.pb
I20260809 23:23:24.769115 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.765277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:52311 (local address 127.1.235.190:43051)
0809 23:23:24.765322 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.765324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.765534 (+ 210us) server_negotiation.cc:407] Connection header received
0809 23:23:24.766069 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.766070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.766079 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.766141 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:24.766742 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.767208 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.768007 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.768177 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.768223 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.768905 (+ 682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:24.768906 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:24.768906 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:24.768916 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:24.768929 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:24.768932 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:24.768971 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.769039 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.769063 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 23:23:24.769294 24271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.765236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:43051 (local address 127.1.235.130:52311)
0809 23:23:24.765413 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:24.765449 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:24.765987 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:24.766212 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:24.766215 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:24.766223 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:24.766667 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.766671 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.767282 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.767283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.767936 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.767938 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.768244 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.768245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.768338 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.768785 (+ 447us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:23:24.768785 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:24.768809 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:23:24.768828 (+ 19us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:24.768981 (+ 153us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:24.768984 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:24.768986 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:23:24.769031 (+ 45us) client_negotiation.cc:240] Negotiation successful
0809 23:23:24.769098 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":92,"threads_started":1}
I20260809 23:23:24.769862 24269 heartbeater.cc:347] Connected to a master server at 127.1.235.190:43051
I20260809 23:23:24.769968 24269 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:24.770157 24269 heartbeater.cc:511] Master 127.1.235.190:43051 requested a full tablet report, sending...
I20260809 23:23:24.770498 23896 ts_manager.cc:194] Registered new tserver with Master: 2432be4ddf374bafa76520aa4a0036f6 (127.1.235.130:34421)
I20260809 23:23:24.770867 23896 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.235.130:52311
I20260809 23:23:24.773797 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 24119
I20260809 23:23:24.773932 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/wal/instance
I20260809 23:23:24.774111 1966 external_mini_cluster.cc:1428] Setting key f4334b1558d54a84d6fe145c9c6c1dc4
I20260809 23:23:24.775022 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.1.235.131:0
--local_ip_for_outbound_sockets=127.1.235.131
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:43051
--builtin_ntp_servers=127.1.235.148:32829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 23:23:24.850620 24272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:24.850787 24272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:24.850807 24272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:24.851816 24272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:24.851864 24272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:24.851918 24272 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.235.131
I20260809 23:23:24.853163 24272 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:32829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.1.235.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.1.235.131
--webserver_port=0
--tserver_master_addrs=127.1.235.190:43051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24272
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.1.235.131
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:24.853415 24272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:24.853734 24272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:24.858040 24282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:24.858036 24279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:24.858036 24278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:24.858291 24272 server_base.cc:1034] running on GCE node
I20260809 23:23:24.858553 24272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:24.858776 24272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:24.859929 24272 hybrid_clock.cc:648] HybridClock initialized: now 1786317804859925 us; error 39 us; skew 500 ppm
I20260809 23:23:24.861032 24272 webserver.cc:460] Webserver started at http://127.1.235.131:34379/ using document root <none> and password file <none>
I20260809 23:23:24.861255 24272 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:24.861320 24272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:24.861454 24272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:24.862445 24272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/data/instance:
uuid: "a4039a3b56434a20a449f69b46332c2b"
format_stamp: "Formatted at 2026-08-09 23:23:24 on dist-test-slave-6nmv"
server_key: "4f538421678549746925021748b336bd"
server_key_iv: "2de3d96e8ed5af034127eb6ea100c6b1"
server_key_version: "encryptionkey@0"
I20260809 23:23:24.862774 24272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance:
uuid: "a4039a3b56434a20a449f69b46332c2b"
format_stamp: "Formatted at 2026-08-09 23:23:24 on dist-test-slave-6nmv"
server_key: "4f538421678549746925021748b336bd"
server_key_iv: "2de3d96e8ed5af034127eb6ea100c6b1"
server_key_version: "encryptionkey@0"
I20260809 23:23:24.864114 24272 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:23:24.864835 24288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:24.864984 24272 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:24.865074 24272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/wal
uuid: "a4039a3b56434a20a449f69b46332c2b"
format_stamp: "Formatted at 2026-08-09 23:23:24 on dist-test-slave-6nmv"
server_key: "4f538421678549746925021748b336bd"
server_key_iv: "2de3d96e8ed5af034127eb6ea100c6b1"
server_key_version: "encryptionkey@0"
I20260809 23:23:24.865151 24272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:24.872046 24272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:24.872304 24272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:24.872455 24272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:24.872665 24272 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 23:23:24.872982 24272 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 23:23:24.873034 24272 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:24.873072 24272 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 23:23:24.873099 24272 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:24.879233 24272 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.131:36923
I20260809 23:23:24.879262 24419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.131:36923 every 8 connection(s)
I20260809 23:23:24.879541 24272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/data/info.pb
I20260809 23:23:24.879793 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 24272
I20260809 23:23:24.879916 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/wal/instance
I20260809 23:23:24.880090 1966 external_mini_cluster.cc:1428] Setting key 6579ae0b4daf635e430f283d62991c97
I20260809 23:23:24.884104 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.880269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.131:54421 (local address 127.1.235.190:43051)
0809 23:23:24.880335 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.880337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.880596 (+ 259us) server_negotiation.cc:407] Connection header received
0809 23:23:24.881115 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.881116 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.881128 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.881180 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:24.881684 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.882186 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.882973 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.883135 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.883190 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.883852 (+ 662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:24.883854 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:24.883854 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:24.883874 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:24.883888 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:24.883892 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:24.883941 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.884020 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.884045 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 23:23:24.884264 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.880257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:43051 (local address 127.1.235.131:54421)
0809 23:23:24.880475 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:24.880514 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:24.881028 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:24.881221 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:24.881224 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:24.881230 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:24.881616 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.881620 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.882263 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.882264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.882889 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.882890 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.883203 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.883203 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.883289 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.883732 (+ 443us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 23:23:24.883732 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:24.883756 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 23:23:24.883776 (+ 20us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:24.883950 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:24.883954 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:24.883956 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:23:24.884006 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 23:23:24.884072 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":123,"threads_started":1}
I20260809 23:23:24.884779 24420 heartbeater.cc:347] Connected to a master server at 127.1.235.190:43051
I20260809 23:23:24.884845 24420 heartbeater.cc:464] Registering TS with master...
I20260809 23:23:24.884955 24420 heartbeater.cc:511] Master 127.1.235.190:43051 requested a full tablet report, sending...
I20260809 23:23:24.885247 23896 ts_manager.cc:194] Registered new tserver with Master: a4039a3b56434a20a449f69b46332c2b (127.1.235.131:36923)
I20260809 23:23:24.885537 23896 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.1.235.131:54421
I20260809 23:23:24.891521 1966 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 23:23:24.895373 23945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.892737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47234 (local address 127.1.235.190:43051)
0809 23:23:24.892772 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.892773 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.892856 (+ 83us) server_negotiation.cc:407] Connection header received
0809 23:23:24.892891 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.892891 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.892898 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.892965 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:24.893134 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.893577 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.894402 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.894636 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.894686 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.895206 (+ 520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:24.895207 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:24.895207 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:24.895211 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:24.895222 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:24.895225 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:24.895263 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.895311 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.895328 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 23:23:24.896754 23896 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47234:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 23:23:24.898227 23896 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 23:23:24.904112 24433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.900306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34156 (local address 127.1.235.131:36923)
0809 23:23:24.900459 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.900462 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.900848 (+ 386us) server_negotiation.cc:407] Connection header received
0809 23:23:24.900884 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.900886 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.900900 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.900969 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:24.901153 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.901820 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.903127 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.903680 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.903753 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.903833 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.904000 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.904036 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
I20260809 23:23:24.904119 24428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.900118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:36923 (local address 127.0.0.1:34156)
0809 23:23:24.900757 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:24.900765 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:24.900800 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:24.901066 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:24.901067 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:24.901068 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:24.901105 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.901107 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.901926 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.901927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.903049 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.903051 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.903777 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.903778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.903863 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.903878 (+ 15us) client_negotiation.cc:769] Sending connection context
0809 23:23:24.903974 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 23:23:24.904028 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"mutex_wait_us":3,"thread_start_us":80,"threads_started":1}
I20260809 23:23:24.904278 24429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.900118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.130:34421 (local address 127.0.0.1:56242)
0809 23:23:24.900652 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:24.900659 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:24.900688 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:24.900938 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:24.900939 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:24.900941 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:24.900981 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.900982 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.902088 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.902088 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.903102 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.903104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.903995 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.903996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.904048 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.904051 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:23:24.904097 (+ 46us) client_negotiation.cc:240] Negotiation successful
0809 23:23:24.904130 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"mutex_wait_us":34,"thread_start_us":78,"threads_started":1}
I20260809 23:23:24.904495 24434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.900324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56242 (local address 127.1.235.130:34421)
0809 23:23:24.900480 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.900483 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.900714 (+ 231us) server_negotiation.cc:407] Connection header received
0809 23:23:24.900753 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.900755 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.900768 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.900829 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:24.901056 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.901990 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.903156 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.903809 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.903875 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.903960 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.904297 (+ 337us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.904427 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
I20260809 23:23:24.904819 24342 tablet_service.cc:1467] Processing CreateTablet for tablet fb50c38799db49fcb99b3c8708e1a4cb (DEFAULT_TABLE table=test-table [id=97b553a2836240a08a9a4dda7e096f2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:24.905063 24189 tablet_service.cc:1467] Processing CreateTablet for tablet fb50c38799db49fcb99b3c8708e1a4cb (DEFAULT_TABLE table=test-table [id=97b553a2836240a08a9a4dda7e096f2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:24.905115 24342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb50c38799db49fcb99b3c8708e1a4cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:24.905345 24189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb50c38799db49fcb99b3c8708e1a4cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:24.906265 24430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.900092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:43625 (local address 127.0.0.1:48250)
0809 23:23:24.900498 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:24.900529 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:24.900582 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:24.900779 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:24.900782 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:24.900784 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:24.900843 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.900845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.902080 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.902081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.903378 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.903380 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.906041 (+ 2661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.906042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.906102 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.906105 (+ 3us) client_negotiation.cc:769] Sending connection context
0809 23:23:24.906169 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 23:23:24.906204 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":324,"thread_start_us":59,"threads_started":1}
I20260809 23:23:24.906294 24432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.900171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48250 (local address 127.1.235.129:43625)
0809 23:23:24.900338 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.900342 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.900592 (+ 250us) server_negotiation.cc:407] Connection header received
0809 23:23:24.900640 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.900641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.900653 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.900748 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:24.900970 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.902000 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.903480 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.905962 (+ 2482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.906028 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.906111 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.906183 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.906222 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
I20260809 23:23:24.907230 24038 tablet_service.cc:1467] Processing CreateTablet for tablet fb50c38799db49fcb99b3c8708e1a4cb (DEFAULT_TABLE table=test-table [id=97b553a2836240a08a9a4dda7e096f2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 23:23:24.907552 24038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb50c38799db49fcb99b3c8708e1a4cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:24.908038 24435 tablet_bootstrap.cc:492] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b: Bootstrap starting.
I20260809 23:23:24.908332 24436 tablet_bootstrap.cc:492] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6: Bootstrap starting.
I20260809 23:23:24.908764 24435 tablet_bootstrap.cc:654] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:24.908981 24436 tablet_bootstrap.cc:654] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:24.909092 24435 log.cc:824] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:24.909299 24436 log.cc:824] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:24.909881 24435 tablet_bootstrap.cc:492] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b: No bootstrap required, opened a new log
I20260809 23:23:24.910115 24436 tablet_bootstrap.cc:492] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6: No bootstrap required, opened a new log
I20260809 23:23:24.910125 24435 ts_tablet_manager.cc:1397] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260809 23:23:24.910190 24436 ts_tablet_manager.cc:1397] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:23:24.910986 24440 tablet_bootstrap.cc:492] T fb50c38799db49fcb99b3c8708e1a4cb P 96f876f471fe44959e187a2dee483964: Bootstrap starting.
I20260809 23:23:24.911674 24440 tablet_bootstrap.cc:654] T fb50c38799db49fcb99b3c8708e1a4cb P 96f876f471fe44959e187a2dee483964: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:24.912012 24440 log.cc:824] T fb50c38799db49fcb99b3c8708e1a4cb P 96f876f471fe44959e187a2dee483964: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:24.912317 24435 raft_consensus.cc:348] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96f876f471fe44959e187a2dee483964" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43625 } } peers { permanent_uuid: "a4039a3b56434a20a449f69b46332c2b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36923 } } peers { permanent_uuid: "2432be4ddf374bafa76520aa4a0036f6" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34421 } }
I20260809 23:23:24.912509 24435 raft_consensus.cc:374] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:24.912556 24435 raft_consensus.cc:729] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4039a3b56434a20a449f69b46332c2b, State: Initialized, Role: FOLLOWER
I20260809 23:23:24.912577 24436 raft_consensus.cc:348] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96f876f471fe44959e187a2dee483964" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43625 } } peers { permanent_uuid: "a4039a3b56434a20a449f69b46332c2b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36923 } } peers { permanent_uuid: "2432be4ddf374bafa76520aa4a0036f6" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34421 } }
I20260809 23:23:24.912696 24435 consensus_queue.cc:260] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96f876f471fe44959e187a2dee483964" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43625 } } peers { permanent_uuid: "a4039a3b56434a20a449f69b46332c2b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36923 } } peers { permanent_uuid: "2432be4ddf374bafa76520aa4a0036f6" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34421 } }
I20260809 23:23:24.912745 24436 raft_consensus.cc:374] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:24.912784 24436 raft_consensus.cc:729] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2432be4ddf374bafa76520aa4a0036f6, State: Initialized, Role: FOLLOWER
I20260809 23:23:24.912850 24440 tablet_bootstrap.cc:492] T fb50c38799db49fcb99b3c8708e1a4cb P 96f876f471fe44959e187a2dee483964: No bootstrap required, opened a new log
I20260809 23:23:24.912937 24440 ts_tablet_manager.cc:1397] T fb50c38799db49fcb99b3c8708e1a4cb P 96f876f471fe44959e187a2dee483964: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260809 23:23:24.912900 24436 consensus_queue.cc:260] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96f876f471fe44959e187a2dee483964" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43625 } } peers { permanent_uuid: "a4039a3b56434a20a449f69b46332c2b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36923 } } peers { permanent_uuid: "2432be4ddf374bafa76520aa4a0036f6" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34421 } }
I20260809 23:23:24.913022 24435 ts_tablet_manager.cc:1428] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:23:24.913132 24420 heartbeater.cc:503] Master 127.1.235.190:43051 was elected leader, sending a full tablet report...
I20260809 23:23:24.913146 24436 ts_tablet_manager.cc:1428] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260809 23:23:24.913251 24269 heartbeater.cc:503] Master 127.1.235.190:43051 was elected leader, sending a full tablet report...
I20260809 23:23:24.915123 24440 raft_consensus.cc:348] T fb50c38799db49fcb99b3c8708e1a4cb P 96f876f471fe44959e187a2dee483964 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96f876f471fe44959e187a2dee483964" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43625 } } peers { permanent_uuid: "a4039a3b56434a20a449f69b46332c2b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36923 } } peers { permanent_uuid: "2432be4ddf374bafa76520aa4a0036f6" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34421 } }
I20260809 23:23:24.915223 24440 raft_consensus.cc:374] T fb50c38799db49fcb99b3c8708e1a4cb P 96f876f471fe44959e187a2dee483964 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:24.915241 24440 raft_consensus.cc:729] T fb50c38799db49fcb99b3c8708e1a4cb P 96f876f471fe44959e187a2dee483964 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96f876f471fe44959e187a2dee483964, State: Initialized, Role: FOLLOWER
I20260809 23:23:24.915347 24440 consensus_queue.cc:260] T fb50c38799db49fcb99b3c8708e1a4cb P 96f876f471fe44959e187a2dee483964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96f876f471fe44959e187a2dee483964" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43625 } } peers { permanent_uuid: "a4039a3b56434a20a449f69b46332c2b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36923 } } peers { permanent_uuid: "2432be4ddf374bafa76520aa4a0036f6" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34421 } }
I20260809 23:23:24.915596 24440 ts_tablet_manager.cc:1428] T fb50c38799db49fcb99b3c8708e1a4cb P 96f876f471fe44959e187a2dee483964: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 23:23:24.915673 24116 heartbeater.cc:503] Master 127.1.235.190:43051 was elected leader, sending a full tablet report...
I20260809 23:23:24.916175 24443 raft_consensus.cc:482] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 23:23:24.916261 24443 raft_consensus.cc:504] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96f876f471fe44959e187a2dee483964" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43625 } } peers { permanent_uuid: "a4039a3b56434a20a449f69b46332c2b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36923 } } peers { permanent_uuid: "2432be4ddf374bafa76520aa4a0036f6" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34421 } }
I20260809 23:23:24.916561 24443 leader_election.cc:288] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96f876f471fe44959e187a2dee483964 (127.1.235.129:43625), a4039a3b56434a20a449f69b46332c2b (127.1.235.131:36923)
I20260809 23:23:24.919818 24432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.916751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:42477 (local address 127.1.235.129:43625)
0809 23:23:24.916802 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.916804 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.916811 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:23:24.916888 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.916889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.916901 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.916961 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:24.917089 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.917681 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.918951 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.919469 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.919552 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.919558 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.919721 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.919752 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 23:23:24.919818 24433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.916855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.1.235.130:53313 (local address 127.1.235.131:36923)
0809 23:23:24.916894 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.916896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.916973 (+ 77us) server_negotiation.cc:407] Connection header received
0809 23:23:24.917041 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.917042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.917068 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.917128 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 23:23:24.917210 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.917762 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.918951 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.919474 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.919552 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.919558 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.919721 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.919752 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 23:23:24.919831 24271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.916737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:43625 (local address 127.1.235.130:42477)
0809 23:23:24.916774 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:24.916784 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:24.916820 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:24.916963 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:24.916963 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:24.916965 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:24.917019 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.917020 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.917745 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.917746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.918853 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.918855 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.919557 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.919558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.919632 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.919636 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 23:23:24.919690 (+ 54us) client_negotiation.cc:240] Negotiation successful
0809 23:23:24.919744 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20,"mutex_wait_us":11}
I20260809 23:23:24.919836 24445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.916744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.131:36923 (local address 127.1.235.130:53313)
0809 23:23:24.916929 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:24.916937 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:24.916993 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:24.917128 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:24.917129 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:24.917130 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 23:23:24.917174 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.917175 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.917847 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.917847 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.918861 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:24.918862 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.919560 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.919560 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:24.919638 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.919640 (+ 2us) client_negotiation.cc:769] Sending connection context
0809 23:23:24.919690 (+ 50us) client_negotiation.cc:240] Negotiation successful
0809 23:23:24.919742 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":34,"thread_start_us":120,"threads_started":1}
I20260809 23:23:24.920176 24062 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb50c38799db49fcb99b3c8708e1a4cb" candidate_uuid: "2432be4ddf374bafa76520aa4a0036f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96f876f471fe44959e187a2dee483964" is_pre_election: true
I20260809 23:23:24.920287 24062 raft_consensus.cc:2454] T fb50c38799db49fcb99b3c8708e1a4cb P 96f876f471fe44959e187a2dee483964 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2432be4ddf374bafa76520aa4a0036f6 in term 0.
I20260809 23:23:24.920315 24365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb50c38799db49fcb99b3c8708e1a4cb" candidate_uuid: "2432be4ddf374bafa76520aa4a0036f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4039a3b56434a20a449f69b46332c2b" is_pre_election: true
I20260809 23:23:24.920424 24365 raft_consensus.cc:2454] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2432be4ddf374bafa76520aa4a0036f6 in term 0.
I20260809 23:23:24.920472 24134 leader_election.cc:302] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2432be4ddf374bafa76520aa4a0036f6, 96f876f471fe44959e187a2dee483964; no voters:
I20260809 23:23:24.920573 24443 raft_consensus.cc:2781] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 23:23:24.920644 24443 raft_consensus.cc:482] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 23:23:24.920674 24443 raft_consensus.cc:3037] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:24.921152 24443 raft_consensus.cc:504] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96f876f471fe44959e187a2dee483964" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43625 } } peers { permanent_uuid: "a4039a3b56434a20a449f69b46332c2b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36923 } } peers { permanent_uuid: "2432be4ddf374bafa76520aa4a0036f6" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34421 } }
I20260809 23:23:24.921264 24443 leader_election.cc:288] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [CANDIDATE]: Term 1 election: Requested vote from peers 96f876f471fe44959e187a2dee483964 (127.1.235.129:43625), a4039a3b56434a20a449f69b46332c2b (127.1.235.131:36923)
I20260809 23:23:24.921402 24062 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb50c38799db49fcb99b3c8708e1a4cb" candidate_uuid: "2432be4ddf374bafa76520aa4a0036f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96f876f471fe44959e187a2dee483964"
I20260809 23:23:24.921435 24365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb50c38799db49fcb99b3c8708e1a4cb" candidate_uuid: "2432be4ddf374bafa76520aa4a0036f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4039a3b56434a20a449f69b46332c2b"
I20260809 23:23:24.921461 24062 raft_consensus.cc:3037] T fb50c38799db49fcb99b3c8708e1a4cb P 96f876f471fe44959e187a2dee483964 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:24.921492 24365 raft_consensus.cc:3037] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:24.922254 24365 raft_consensus.cc:2454] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2432be4ddf374bafa76520aa4a0036f6 in term 1.
I20260809 23:23:24.922274 24062 raft_consensus.cc:2454] T fb50c38799db49fcb99b3c8708e1a4cb P 96f876f471fe44959e187a2dee483964 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2432be4ddf374bafa76520aa4a0036f6 in term 1.
I20260809 23:23:24.922446 24137 leader_election.cc:302] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2432be4ddf374bafa76520aa4a0036f6, a4039a3b56434a20a449f69b46332c2b; no voters:
I20260809 23:23:24.922528 24443 raft_consensus.cc:2781] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:24.922664 24443 raft_consensus.cc:686] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [term 1 LEADER]: Becoming Leader. State: Replica: 2432be4ddf374bafa76520aa4a0036f6, State: Running, Role: LEADER
I20260809 23:23:24.922753 24443 consensus_queue.cc:237] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96f876f471fe44959e187a2dee483964" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43625 } } peers { permanent_uuid: "a4039a3b56434a20a449f69b46332c2b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36923 } } peers { permanent_uuid: "2432be4ddf374bafa76520aa4a0036f6" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34421 } }
I20260809 23:23:24.923415 23896 catalog_manager.cc:5495] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2432be4ddf374bafa76520aa4a0036f6 (127.1.235.130). New cstate: current_term: 1 leader_uuid: "2432be4ddf374bafa76520aa4a0036f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96f876f471fe44959e187a2dee483964" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4039a3b56434a20a449f69b46332c2b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2432be4ddf374bafa76520aa4a0036f6" member_type: VOTER last_known_addr { host: "127.1.235.130" port: 34421 } health_report { overall_health: HEALTHY } } }
I20260809 23:23:24.933005 24434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.931003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56254 (local address 127.1.235.130:34421)
0809 23:23:24.931051 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:24.931053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:24.931060 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:23:24.931084 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:24.931085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:24.931098 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:24.931155 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:23:24.931278 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.931689 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.932351 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:24.932567 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:24.932617 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:24.932739 (+ 122us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:23:24.932813 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:23:24.932888 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:24.932942 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 23:23:24.932954 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 23:23:24.934506 24365 raft_consensus.cc:1261] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b [term 1 FOLLOWER]: Refusing update from remote peer 2432be4ddf374bafa76520aa4a0036f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:23:24.934574 24062 raft_consensus.cc:1261] T fb50c38799db49fcb99b3c8708e1a4cb P 96f876f471fe44959e187a2dee483964 [term 1 FOLLOWER]: Refusing update from remote peer 2432be4ddf374bafa76520aa4a0036f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:23:24.934924 24446 consensus_queue.cc:1035] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96f876f471fe44959e187a2dee483964" member_type: VOTER last_known_addr { host: "127.1.235.129" port: 43625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:23:24.935026 24443 consensus_queue.cc:1035] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4039a3b56434a20a449f69b46332c2b" member_type: VOTER last_known_addr { host: "127.1.235.131" port: 36923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:23:24.937626 24452 mvcc.cc:205] Tried to move back new op lower bound from 7316757729009524736 to 7316757728964100096. Current Snapshot: MvccSnapshot[applied={T|T < 7316757729009524736}]
I20260809 23:23:24.939069 23896 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47234:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:23:24.939145 23896 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47234:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 23:23:24.939788 23896 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 40b1f387a839443db9c8b6a3a3fdcb3f: Sending DeleteTablet for 3 replicas of tablet fb50c38799db49fcb99b3c8708e1a4cb
I20260809 23:23:24.940074 24189 tablet_service.cc:1514] Processing DeleteTablet for tablet fb50c38799db49fcb99b3c8708e1a4cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:24 UTC) from {username='slave'} at 127.0.0.1:56242
I20260809 23:23:24.940069 24038 tablet_service.cc:1514] Processing DeleteTablet for tablet fb50c38799db49fcb99b3c8708e1a4cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:24 UTC) from {username='slave'} at 127.0.0.1:48250
I20260809 23:23:24.940095 24342 tablet_service.cc:1514] Processing DeleteTablet for tablet fb50c38799db49fcb99b3c8708e1a4cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 23:23:24 UTC) from {username='slave'} at 127.0.0.1:34156
I20260809 23:23:24.940303 24465 tablet_replica.cc:330] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6: stopping tablet replica
I20260809 23:23:24.940407 24463 tablet_replica.cc:330] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b: stopping tablet replica
I20260809 23:23:24.940428 24465 raft_consensus.cc:2229] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [term 1 LEADER]: Raft consensus shutting down.
I20260809 23:23:24.940476 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 23966
I20260809 23:23:24.940495 24463 raft_consensus.cc:2229] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 23:23:24.943280 24465 raft_consensus.cc:2258] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:23:24.943784 24465 ts_tablet_manager.cc:1905] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:23:24.945076 24463 raft_consensus.cc:2258] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 23:23:24.945410 24465 ts_tablet_manager.cc:1918] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:23:24.945483 24465 log.cc:1196] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-1/wal/wals/fb50c38799db49fcb99b3c8708e1a4cb
I20260809 23:23:24.945690 24463 ts_tablet_manager.cc:1905] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 23:23:24.945752 24465 ts_tablet_manager.cc:1939] T fb50c38799db49fcb99b3c8708e1a4cb P 2432be4ddf374bafa76520aa4a0036f6: Deleting consensus metadata
I20260809 23:23:24.946113 23881 catalog_manager.cc:4841] TS 2432be4ddf374bafa76520aa4a0036f6 (127.1.235.130:34421): tablet fb50c38799db49fcb99b3c8708e1a4cb (table test-table [id=97b553a2836240a08a9a4dda7e096f2d]) successfully deleted
I20260809 23:23:24.947697 24463 ts_tablet_manager.cc:1918] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 23:23:24.947821 24463 log.cc:1196] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b: Deleting WAL directory at /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786317539151495-1966-0/minicluster-data/ts-2/wal/wals/fb50c38799db49fcb99b3c8708e1a4cb
I20260809 23:23:24.948107 24463 ts_tablet_manager.cc:1939] T fb50c38799db49fcb99b3c8708e1a4cb P a4039a3b56434a20a449f69b46332c2b: Deleting consensus metadata
I20260809 23:23:24.948495 23880 catalog_manager.cc:4841] TS a4039a3b56434a20a449f69b46332c2b (127.1.235.131:36923): tablet fb50c38799db49fcb99b3c8708e1a4cb (table test-table [id=97b553a2836240a08a9a4dda7e096f2d]) successfully deleted
W20260809 23:23:24.949333 23878 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.1.235.129:43625 (error 108)
I20260809 23:23:24.949743 24430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:24.949614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.129:43625 (local address 127.0.0.1:48252)
0809 23:23:24.949675 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:24.949710 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.129:43625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 23:23:24.949854 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 24119
W20260809 23:23:24.955009 23878 catalog_manager.cc:4584] TS 96f876f471fe44959e187a2dee483964 (127.1.235.129:43625): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fb50c38799db49fcb99b3c8708e1a4cb: Network error: Client connection negotiation failed: client connection to 127.1.235.129:43625: connect: Connection refused (error 111)
I20260809 23:23:24.958390 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 24272
I20260809 23:23:24.963347 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 23863
2026-08-09T23:23:24Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (638 ms)
[----------] 6 tests from EncryptionPolicyTest (7864 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:25 dist-test-slave-6nmv krb5kdc[24470](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:25 dist-test-slave-6nmv krb5kdc[24470](info): set up 2 sockets
Aug 09 23:23:25 dist-test-slave-6nmv krb5kdc[24470](info): commencing operation
krb5kdc: starting...
W20260809 23:23:25.960660 1966 mini_kdc.cc:121] Time spent starting KDC: real 0.977s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:26 dist-test-slave-6nmv krb5kdc[24470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 23:23:26.068656 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42101
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42101
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:26.143483 24484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:26.143723 24484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:26.143764 24484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:26.144881 24484 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:26.144951 24484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:26.144994 24484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:26.145013 24484 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:26.145040 24484 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:26.146370 24484 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42101
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:26.146641 24484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:26.146849 24484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:26.151350 24492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:26.151383 24489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:26.151350 24490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:26.151517 24484 server_base.cc:1034] running on GCE node
I20260809 23:23:26.151846 24484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:26.152128 24484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:26.153306 24484 hybrid_clock.cc:648] HybridClock initialized: now 1786317806153282 us; error 37 us; skew 500 ppm
Aug 09 23:23:26 dist-test-slave-6nmv krb5kdc[24470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317806, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:26.155808 24484 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 23:23:26.156141 24484 webserver.cc:460] Webserver started at http://127.0.0.1:35647/ using document root <none> and password file <none>
I20260809 23:23:26.156297 24484 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:26.156332 24484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:26.156417 24484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:26.157265 24484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "e341d81a41de4ac2b3b7757462929254"
format_stamp: "Formatted at 2026-08-09 23:23:26 on dist-test-slave-6nmv"
server_key: "5daa6aa233de4d888a0cadc17889f419"
server_key_iv: "2b37e3b11c1b225aa3b4c7e9d43bf361"
server_key_version: "encryptionkey@0"
I20260809 23:23:26.157617 24484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "e341d81a41de4ac2b3b7757462929254"
format_stamp: "Formatted at 2026-08-09 23:23:26 on dist-test-slave-6nmv"
server_key: "5daa6aa233de4d888a0cadc17889f419"
server_key_iv: "2b37e3b11c1b225aa3b4c7e9d43bf361"
server_key_version: "encryptionkey@0"
I20260809 23:23:26.158981 24484 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 23:23:26.159595 24500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:26.159737 24484 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:26.159822 24484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "e341d81a41de4ac2b3b7757462929254"
format_stamp: "Formatted at 2026-08-09 23:23:26 on dist-test-slave-6nmv"
server_key: "5daa6aa233de4d888a0cadc17889f419"
server_key_iv: "2b37e3b11c1b225aa3b4c7e9d43bf361"
server_key_version: "encryptionkey@0"
I20260809 23:23:26.159873 24484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:26.175243 24484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:26.177182 24484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:26.177276 24484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:26.180832 24484 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42101
I20260809 23:23:26.180874 24559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42101 every 8 connection(s)
I20260809 23:23:26.181173 24484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:26.182080 24560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:26.182780 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 24484
I20260809 23:23:26.182893 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:26.183087 1966 external_mini_cluster.cc:1428] Setting key 7780408819f467a2a02687eb52a3de33
I20260809 23:23:26.185250 24560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254: Bootstrap starting.
I20260809 23:23:26.185782 24560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:26.186064 24560 log.cc:824] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:26.186739 24560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254: No bootstrap required, opened a new log
I20260809 23:23:26.188934 24560 raft_consensus.cc:348] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e341d81a41de4ac2b3b7757462929254" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42101 } }
I20260809 23:23:26.189043 24560 raft_consensus.cc:374] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:26.189061 24560 raft_consensus.cc:729] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e341d81a41de4ac2b3b7757462929254, State: Initialized, Role: FOLLOWER
I20260809 23:23:26.189162 24560 consensus_queue.cc:260] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e341d81a41de4ac2b3b7757462929254" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42101 } }
I20260809 23:23:26.189224 24560 raft_consensus.cc:388] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:26.189244 24560 raft_consensus.cc:482] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:26.189286 24560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [term 0 FOLLOWER]: Advancing to term 1
Aug 09 23:23:26 dist-test-slave-6nmv krb5kdc[24470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 23:23:26.189850 24560 raft_consensus.cc:504] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e341d81a41de4ac2b3b7757462929254" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42101 } }
I20260809 23:23:26.189958 24560 leader_election.cc:302] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e341d81a41de4ac2b3b7757462929254; no voters:
I20260809 23:23:26.190104 24560 leader_election.cc:288] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:26.190153 24565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:26.190284 24565 raft_consensus.cc:686] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [term 1 LEADER]: Becoming Leader. State: Replica: e341d81a41de4ac2b3b7757462929254, State: Running, Role: LEADER
I20260809 23:23:26.190361 24560 sys_catalog.cc:564] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:26.190382 24565 consensus_queue.cc:237] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e341d81a41de4ac2b3b7757462929254" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42101 } }
I20260809 23:23:26.190730 24565 sys_catalog.cc:455] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e341d81a41de4ac2b3b7757462929254. Latest consensus state: current_term: 1 leader_uuid: "e341d81a41de4ac2b3b7757462929254" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e341d81a41de4ac2b3b7757462929254" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42101 } } }
I20260809 23:23:26.190877 24565 sys_catalog.cc:458] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:26.190742 24567 sys_catalog.cc:455] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e341d81a41de4ac2b3b7757462929254" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e341d81a41de4ac2b3b7757462929254" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42101 } } }
I20260809 23:23:26.191129 24567 sys_catalog.cc:458] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:26.191273 24577 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:26.191964 24577 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:26.193636 24563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:26.183571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48203 (local address 127.0.0.1:42101)
0809 23:23:26.183752 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:26.183760 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:26.183860 (+ 100us) server_negotiation.cc:407] Connection header received
0809 23:23:26.184280 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:26.184286 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:26.184328 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:26.184439 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:26.185220 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:26.186160 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:26.187023 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:26.187385 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:26.187464 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:26.189907 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:26.189911 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:26.189911 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:26.189922 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:26.191943 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:26.192399 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:26.192402 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:26.192402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:26.192510 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:26.192775 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:26.192776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:26.192776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:26.193053 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:26.193199 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:26.193336 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 23:23:26.193439 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":89,"threads_started":1}
I20260809 23:23:26.194640 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:26.198163 24577 catalog_manager.cc:1347] Generated new cluster ID: 5d257e15cb2c49dda4bf7d91862d5483
I20260809 23:23:26.198208 24577 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:26.201956 24563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:26.196008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37651 (local address 127.0.0.1:42101)
0809 23:23:26.196041 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:26.196042 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:26.196081 (+ 39us) server_negotiation.cc:407] Connection header received
0809 23:23:26.196131 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:26.196131 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:26.196138 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:26.196196 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:26.196592 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:26.197238 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:26.197840 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:26.198103 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:26.198161 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:26.199424 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:26.199425 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:26.199425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:26.199431 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:26.200783 (+ 1352us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:26.201190 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:26.201191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:26.201191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:26.201243 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:26.201479 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:26.201480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:26.201480 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:26.201580 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:26.201658 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:26.201822 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 23:23:26.201882 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:23:26.225345 24577 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:26.226020 24577 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:26.232121 24577 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e341d81a41de4ac2b3b7757462929254: Generated new TSK 0
I20260809 23:23:26.232292 24577 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:26.239787 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 24484
W20260809 23:23:26.246001 24468 connection.cc:535] client connection to 127.0.0.1:42101 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42101): Connection reset by peer (error 104)
2026-08-09T23:23:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1275 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:26 dist-test-slave-6nmv krb5kdc[24598](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:26 dist-test-slave-6nmv krb5kdc[24598](info): set up 2 sockets
Aug 09 23:23:26 dist-test-slave-6nmv krb5kdc[24598](info): commencing operation
krb5kdc: starting...
W20260809 23:23:27.257753 1966 mini_kdc.cc:121] Time spent starting KDC: real 0.998s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:27 dist-test-slave-6nmv krb5kdc[24598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 23:23:27.373942 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45727
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45727
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:27.450469 24612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:27.450645 24612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:27.450666 24612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:27.451776 24612 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:27.451817 24612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:27.451831 24612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:27.451843 24612 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:27.451879 24612 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:27.453361 24612 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45727
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:27.453627 24612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:27.453886 24612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:27.458833 24621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:27.458957 24612 server_base.cc:1034] running on GCE node
W20260809 23:23:27.458840 24618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:27.459090 24619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:27.459364 24612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:27.459627 24612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:27.460775 24612 hybrid_clock.cc:648] HybridClock initialized: now 1786317807460749 us; error 45 us; skew 500 ppm
Aug 09 23:23:27 dist-test-slave-6nmv krb5kdc[24598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317807, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:27.463459 24612 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 23:23:27.463948 24612 webserver.cc:460] Webserver started at http://127.0.0.1:46659/ using document root <none> and password file <none>
I20260809 23:23:27.464179 24612 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:27.464252 24612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:27.464414 24612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:27.465444 24612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "fc04cd063edd4c898b71f031ed36b71f"
format_stamp: "Formatted at 2026-08-09 23:23:27 on dist-test-slave-6nmv"
server_key: "52cea56033a16acf3d46d94c42c688a1"
server_key_iv: "b56b07a6ff034bc363f39a7029900d79"
server_key_version: "encryptionkey@0"
I20260809 23:23:27.465852 24612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "fc04cd063edd4c898b71f031ed36b71f"
format_stamp: "Formatted at 2026-08-09 23:23:27 on dist-test-slave-6nmv"
server_key: "52cea56033a16acf3d46d94c42c688a1"
server_key_iv: "b56b07a6ff034bc363f39a7029900d79"
server_key_version: "encryptionkey@0"
I20260809 23:23:27.467196 24612 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:23:27.467892 24628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:27.468055 24612 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:23:27.468152 24612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "fc04cd063edd4c898b71f031ed36b71f"
format_stamp: "Formatted at 2026-08-09 23:23:27 on dist-test-slave-6nmv"
server_key: "52cea56033a16acf3d46d94c42c688a1"
server_key_iv: "b56b07a6ff034bc363f39a7029900d79"
server_key_version: "encryptionkey@0"
I20260809 23:23:27.468236 24612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:27.486593 24612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:27.488955 24612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:27.489122 24612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:27.493170 24612 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45727
I20260809 23:23:27.493196 24685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45727 every 8 connection(s)
I20260809 23:23:27.493526 24612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:27.494566 24688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:27.496609 24688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f: Bootstrap starting.
I20260809 23:23:27.497188 24688 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:27.497426 24688 log.cc:824] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:27.498159 24688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f: No bootstrap required, opened a new log
I20260809 23:23:27.498322 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 24612
I20260809 23:23:27.498446 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:27.498656 1966 external_mini_cluster.cc:1428] Setting key 78e48f4a198b40e5176cf36668eca28b
I20260809 23:23:27.500062 24688 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc04cd063edd4c898b71f031ed36b71f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45727 } }
I20260809 23:23:27.500205 24688 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:27.500238 24688 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc04cd063edd4c898b71f031ed36b71f, State: Initialized, Role: FOLLOWER
I20260809 23:23:27.500401 24688 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc04cd063edd4c898b71f031ed36b71f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45727 } }
I20260809 23:23:27.500480 24688 raft_consensus.cc:388] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:27.500500 24688 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:27.500558 24688 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:27.501039 24688 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc04cd063edd4c898b71f031ed36b71f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45727 } }
I20260809 23:23:27.501116 24688 leader_election.cc:302] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fc04cd063edd4c898b71f031ed36b71f; no voters:
I20260809 23:23:27.501283 24688 leader_election.cc:288] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:27.501302 24695 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:27.501406 24695 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [term 1 LEADER]: Becoming Leader. State: Replica: fc04cd063edd4c898b71f031ed36b71f, State: Running, Role: LEADER
I20260809 23:23:27.501519 24688 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:27.501535 24695 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc04cd063edd4c898b71f031ed36b71f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45727 } }
I20260809 23:23:27.501982 24697 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc04cd063edd4c898b71f031ed36b71f. Latest consensus state: current_term: 1 leader_uuid: "fc04cd063edd4c898b71f031ed36b71f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc04cd063edd4c898b71f031ed36b71f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45727 } } }
I20260809 23:23:27.502122 24697 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:27.502605 24704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:27.502919 24696 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fc04cd063edd4c898b71f031ed36b71f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fc04cd063edd4c898b71f031ed36b71f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45727 } } }
I20260809 23:23:27.503806 24696 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:27.503988 24704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:27.504662 24694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:27.499116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50363 (local address 127.0.0.1:45727)
0809 23:23:27.499300 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:27.499314 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:27.499339 (+ 25us) server_negotiation.cc:407] Connection header received
0809 23:23:27.500050 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:27.500055 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:27.500097 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:27.500216 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:27.500418 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:27.501666 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:27.502691 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:27.503189 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:27.503321 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:27.504033 (+ 712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:27.504037 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:27.504037 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:27.504235 (+ 198us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:27.504264 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:27.504275 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:27.504370 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:27.504478 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 23:23:27.504504 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":96,"threads_started":1}
I20260809 23:23:27.505686 24704 catalog_manager.cc:1347] Generated new cluster ID: bf048592e58e43dbbcf533e59c1d8e15
I20260809 23:23:27.505740 24704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:27.505939 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:27.512652 24694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:27.507170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46277 (local address 127.0.0.1:45727)
0809 23:23:27.507203 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:27.507205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:27.510053 (+ 2848us) server_negotiation.cc:407] Connection header received
0809 23:23:27.510113 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:27.510114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:27.510135 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:27.510183 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:27.510294 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:27.510735 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:27.511405 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:27.511638 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:27.511736 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:27.512396 (+ 660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:27.512397 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:27.512397 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:27.512401 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:27.512414 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:27.512418 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:27.512474 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:27.512548 (+ 74us) server_negotiation.cc:299] Negotiation successful
0809 23:23:27.512559 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 23:23:27.517007 24704 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:27.517613 24704 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:27.521137 24704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fc04cd063edd4c898b71f031ed36b71f: Generated new TSK 0
I20260809 23:23:27.521284 24704 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:27.526801 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 24612
W20260809 23:23:27.533077 24595 connection.cc:535] client connection to 127.0.0.1:45727 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45727): Connection reset by peer (error 104)
2026-08-09T23:23:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1287 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:27 dist-test-slave-6nmv krb5kdc[24721](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:27 dist-test-slave-6nmv krb5kdc[24721](info): set up 2 sockets
Aug 09 23:23:27 dist-test-slave-6nmv krb5kdc[24721](info): commencing operation
krb5kdc: starting...
W20260809 23:23:28.536551 1966 mini_kdc.cc:121] Time spent starting KDC: real 0.990s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:28 dist-test-slave-6nmv krb5kdc[24721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 23:23:28.641646 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42505
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42505
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:28.716691 24738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:28.716876 24738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:28.716897 24738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:28.717852 24738 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:28.717913 24738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:28.717928 24738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:28.717941 24738 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:28.717953 24738 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:28.719336 24738 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42505
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:28.719520 24738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:28.719686 24738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:28.724170 24746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:28.724212 24738 server_base.cc:1034] running on GCE node
W20260809 23:23:28.724174 24744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:28.724215 24743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:28.724651 24738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:28.724927 24738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:28.726099 24738 hybrid_clock.cc:648] HybridClock initialized: now 1786317808726093 us; error 36 us; skew 500 ppm
Aug 09 23:23:28 dist-test-slave-6nmv krb5kdc[24721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317808, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:28.733716 24738 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 23:23:28.734148 24738 webserver.cc:460] Webserver started at http://127.0.0.1:45849/ using document root <none> and password file <none>
I20260809 23:23:28.734337 24738 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:28.734376 24738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:28.734472 24738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:28.735401 24738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "479539e05f044eb09b8126ffff218f4e"
format_stamp: "Formatted at 2026-08-09 23:23:28 on dist-test-slave-6nmv"
server_key: "76e0715a8c3a184ef39dc58a905a5203"
server_key_iv: "6104e97cd216a9a0bdb44025cacbe6ce"
server_key_version: "encryptionkey@0"
I20260809 23:23:28.735651 24738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "479539e05f044eb09b8126ffff218f4e"
format_stamp: "Formatted at 2026-08-09 23:23:28 on dist-test-slave-6nmv"
server_key: "76e0715a8c3a184ef39dc58a905a5203"
server_key_iv: "6104e97cd216a9a0bdb44025cacbe6ce"
server_key_version: "encryptionkey@0"
I20260809 23:23:28.736734 24738 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 23:23:28.737331 24754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:28.737483 24738 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:23:28.737574 24738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "479539e05f044eb09b8126ffff218f4e"
format_stamp: "Formatted at 2026-08-09 23:23:28 on dist-test-slave-6nmv"
server_key: "76e0715a8c3a184ef39dc58a905a5203"
server_key_iv: "6104e97cd216a9a0bdb44025cacbe6ce"
server_key_version: "encryptionkey@0"
I20260809 23:23:28.737620 24738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:28.740283 24738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:28.741758 24738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:28.741923 24738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:28.745393 24738 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42505
I20260809 23:23:28.745456 24807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42505 every 8 connection(s)
I20260809 23:23:28.745724 24738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:28.746605 24808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:28.748440 24808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e: Bootstrap starting.
I20260809 23:23:28.748921 24808 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:28.749181 24808 log.cc:824] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:28.749755 24808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e: No bootstrap required, opened a new log
I20260809 23:23:28.751137 24808 raft_consensus.cc:348] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479539e05f044eb09b8126ffff218f4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42505 } }
I20260809 23:23:28.751273 24808 raft_consensus.cc:374] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:28.751317 24808 raft_consensus.cc:729] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479539e05f044eb09b8126ffff218f4e, State: Initialized, Role: FOLLOWER
I20260809 23:23:28.751451 24808 consensus_queue.cc:260] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479539e05f044eb09b8126ffff218f4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42505 } }
I20260809 23:23:28.751525 24808 raft_consensus.cc:388] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:28.751565 24808 raft_consensus.cc:482] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:28.751618 24808 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:28.752144 24808 raft_consensus.cc:504] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479539e05f044eb09b8126ffff218f4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42505 } }
I20260809 23:23:28.752251 24808 leader_election.cc:302] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 479539e05f044eb09b8126ffff218f4e; no voters:
I20260809 23:23:28.752421 24808 leader_election.cc:288] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:28.752449 24811 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:28.752597 24811 raft_consensus.cc:686] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [term 1 LEADER]: Becoming Leader. State: Replica: 479539e05f044eb09b8126ffff218f4e, State: Running, Role: LEADER
I20260809 23:23:28.752660 24808 sys_catalog.cc:564] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:28.752688 24811 consensus_queue.cc:237] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479539e05f044eb09b8126ffff218f4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42505 } }
I20260809 23:23:28.753013 24814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "479539e05f044eb09b8126ffff218f4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479539e05f044eb09b8126ffff218f4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42505 } } }
I20260809 23:23:28.753103 24814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:28.753129 24813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 479539e05f044eb09b8126ffff218f4e. Latest consensus state: current_term: 1 leader_uuid: "479539e05f044eb09b8126ffff218f4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479539e05f044eb09b8126ffff218f4e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42505 } } }
I20260809 23:23:28.753203 24813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:28.753279 24820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:28.753777 24820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:28.755232 24820 catalog_manager.cc:1347] Generated new cluster ID: 0a4aff6d35734355b7a37124edf6990d
I20260809 23:23:28.755280 24820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:28.755590 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 24738
I20260809 23:23:28.755722 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:28.755882 1966 external_mini_cluster.cc:1428] Setting key 5cca5b70a6103264d9b7efa0ba707829
I20260809 23:23:28.757913 24835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:28.756440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41615 (local address 127.0.0.1:42505)
0809 23:23:28.756575 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:28.756582 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:28.756609 (+ 27us) server_negotiation.cc:407] Connection header received
0809 23:23:28.756709 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:28.756714 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:28.756739 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:28.756846 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:28.757501 (+ 655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:28.757504 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:28.757504 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:28.757507 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:28.757540 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:28.757552 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:28.757609 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:28.757701 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 23:23:28.757737 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":67,"threads_started":1}
I20260809 23:23:28.758766 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:28.761000 24835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:28.760073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36523 (local address 127.0.0.1:42505)
0809 23:23:28.760113 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:28.760115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:28.760207 (+ 92us) server_negotiation.cc:407] Connection header received
0809 23:23:28.760252 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:28.760253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:28.760257 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:28.760304 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:28.760815 (+ 511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:28.760816 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:28.760816 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:28.760820 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:28.760832 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:28.760835 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:28.760883 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:28.760935 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 23:23:28.760945 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260809 23:23:28.766513 24820 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:28.766656 24820 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:28.771458 24820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 479539e05f044eb09b8126ffff218f4e: Generated new TSK 0
I20260809 23:23:28.771629 24820 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:28.776748 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 24738
2026-08-09T23:23:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1250 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:28 dist-test-slave-6nmv krb5kdc[24845](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:28 dist-test-slave-6nmv krb5kdc[24845](info): set up 2 sockets
Aug 09 23:23:28 dist-test-slave-6nmv krb5kdc[24845](info): commencing operation
krb5kdc: starting...
W20260809 23:23:29.773721 1966 mini_kdc.cc:121] Time spent starting KDC: real 0.977s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:29 dist-test-slave-6nmv krb5kdc[24845](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 23:23:29.880642 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40163
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:29.956516 24858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:29.956725 24858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:29.956760 24858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:29.957885 24858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:29.957955 24858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:29.957980 24858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:29.958002 24858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:29.958033 24858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:29.959403 24858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:29.959703 24858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:29.959925 24858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:29.964440 24869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:29.964600 24858 server_base.cc:1034] running on GCE node
W20260809 23:23:29.964574 24864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:29.964527 24866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:29.964964 24858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:29.965284 24858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:29.966423 24858 hybrid_clock.cc:648] HybridClock initialized: now 1786317809966397 us; error 41 us; skew 500 ppm
Aug 09 23:23:29 dist-test-slave-6nmv krb5kdc[24845](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317809, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:29.968921 24858 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 23:23:29.969322 24858 webserver.cc:460] Webserver started at http://127.0.0.1:39611/ using document root <none> and password file <none>
I20260809 23:23:29.969537 24858 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:29.969583 24858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:29.969729 24858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:29.970769 24858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "56475ddedf2c4c2f98ed57cdd2fd1527"
format_stamp: "Formatted at 2026-08-09 23:23:29 on dist-test-slave-6nmv"
server_key: "b3c1f7eb82e19a89ee6d7e83c63c566a"
server_key_iv: "f2e464e34ef72b02e62b54a5b5aef5d4"
server_key_version: "encryptionkey@0"
I20260809 23:23:29.971125 24858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "56475ddedf2c4c2f98ed57cdd2fd1527"
format_stamp: "Formatted at 2026-08-09 23:23:29 on dist-test-slave-6nmv"
server_key: "b3c1f7eb82e19a89ee6d7e83c63c566a"
server_key_iv: "f2e464e34ef72b02e62b54a5b5aef5d4"
server_key_version: "encryptionkey@0"
I20260809 23:23:29.972496 24858 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:23:29.973316 24878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:29.973505 24858 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:23:29.973604 24858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "56475ddedf2c4c2f98ed57cdd2fd1527"
format_stamp: "Formatted at 2026-08-09 23:23:29 on dist-test-slave-6nmv"
server_key: "b3c1f7eb82e19a89ee6d7e83c63c566a"
server_key_iv: "f2e464e34ef72b02e62b54a5b5aef5d4"
server_key_version: "encryptionkey@0"
I20260809 23:23:29.973688 24858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:29.992725 24858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:29.994923 24858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:29.995100 24858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:29.998951 24858 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40163
I20260809 23:23:29.998997 24934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40163 every 8 connection(s)
I20260809 23:23:29.999326 24858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:30.000216 24935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:30.002326 24935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527: Bootstrap starting.
I20260809 23:23:30.002882 24935 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:30.003127 24935 log.cc:824] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:30.003793 24935 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527: No bootstrap required, opened a new log
I20260809 23:23:30.004613 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 24858
I20260809 23:23:30.004740 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:30.004948 1966 external_mini_cluster.cc:1428] Setting key 99ebddc1a8cbb0a3c44754a9ec167c40
I20260809 23:23:30.006052 24935 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56475ddedf2c4c2f98ed57cdd2fd1527" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40163 } }
I20260809 23:23:30.006222 24935 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:30.006260 24935 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56475ddedf2c4c2f98ed57cdd2fd1527, State: Initialized, Role: FOLLOWER
I20260809 23:23:30.006450 24935 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56475ddedf2c4c2f98ed57cdd2fd1527" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40163 } }
I20260809 23:23:30.006551 24935 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:30.006590 24935 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:30.006647 24935 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:30.007654 24935 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56475ddedf2c4c2f98ed57cdd2fd1527" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40163 } }
I20260809 23:23:30.007745 24935 leader_election.cc:302] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56475ddedf2c4c2f98ed57cdd2fd1527; no voters:
I20260809 23:23:30.007959 24935 leader_election.cc:288] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:30.007988 24940 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:30.008101 24940 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [term 1 LEADER]: Becoming Leader. State: Replica: 56475ddedf2c4c2f98ed57cdd2fd1527, State: Running, Role: LEADER
I20260809 23:23:30.008239 24935 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:30.008244 24940 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56475ddedf2c4c2f98ed57cdd2fd1527" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40163 } }
I20260809 23:23:30.008836 24942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56475ddedf2c4c2f98ed57cdd2fd1527. Latest consensus state: current_term: 1 leader_uuid: "56475ddedf2c4c2f98ed57cdd2fd1527" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56475ddedf2c4c2f98ed57cdd2fd1527" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40163 } } }
I20260809 23:23:30.008937 24942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:30.009174 24941 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56475ddedf2c4c2f98ed57cdd2fd1527" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56475ddedf2c4c2f98ed57cdd2fd1527" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40163 } } }
I20260809 23:23:30.009588 24941 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:30.009795 24947 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:30.010605 24947 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:30.012130 24947 catalog_manager.cc:1347] Generated new cluster ID: e53b219e5d584e9588982a01583530d4
Aug 09 23:23:30 dist-test-slave-6nmv krb5kdc[24845](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 23:23:30.012187 24947 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:30.016184 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:30.005477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56469 (local address 127.0.0.1:40163)
0809 23:23:30.005673 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:30.005681 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:30.005705 (+ 24us) server_negotiation.cc:407] Connection header received
0809 23:23:30.006040 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:30.006046 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:30.006099 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:30.006233 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:30.007050 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:30.008141 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:30.009129 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:30.009743 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:30.010241 (+ 498us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:30.012670 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:30.012674 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:30.012674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:30.012686 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:30.014519 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:30.014904 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:30.014907 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:30.014907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:30.015014 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:30.015232 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:30.015233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:30.015233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:30.015476 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:30.015635 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:30.015744 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 23:23:30.015895 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":92,"threads_started":1}
I20260809 23:23:30.017175 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:30.020170 24947 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:30.020689 24947 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:30.026863 24947 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56475ddedf2c4c2f98ed57cdd2fd1527: Generated new TSK 0
I20260809 23:23:30.027035 24947 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:30.032825 24939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:30.026139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35043 (local address 127.0.0.1:40163)
0809 23:23:30.026196 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:30.026198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:30.026388 (+ 190us) server_negotiation.cc:407] Connection header received
0809 23:23:30.026438 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:30.026439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:30.026452 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:30.026515 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:30.027216 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:30.027704 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:30.028451 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:30.028681 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:30.028756 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:30.030022 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:30.030024 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:30.030024 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:30.030031 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:30.031659 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:30.032030 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:30.032032 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:30.032032 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:30.032096 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:30.032295 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:30.032295 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:30.032296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:30.032421 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:30.032537 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:30.032641 (+ 104us) server_negotiation.cc:299] Negotiation successful
0809 23:23:30.032725 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 23:23:30.034761 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 24858
2026-08-09T23:23:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1260 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:30 dist-test-slave-6nmv krb5kdc[24970](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:30 dist-test-slave-6nmv krb5kdc[24970](info): set up 2 sockets
Aug 09 23:23:30 dist-test-slave-6nmv krb5kdc[24970](info): commencing operation
krb5kdc: starting...
W20260809 23:23:31.077656 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.021s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:31 dist-test-slave-6nmv krb5kdc[24970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 23:23:31.190770 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46109
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46109
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:31.266456 24983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:31.266680 24983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:31.266714 24983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:31.267802 24983 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:31.267866 24983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:31.267889 24983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:31.267907 24983 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:31.267936 24983 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:31.269337 24983 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46109
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:31.269605 24983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:31.269843 24983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:31.274529 24988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:31.274566 24993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:31.274609 24983 server_base.cc:1034] running on GCE node
W20260809 23:23:31.274492 24991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:31.274883 24983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:31.275254 24983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:31.276412 24983 hybrid_clock.cc:648] HybridClock initialized: now 1786317811276398 us; error 26 us; skew 500 ppm
Aug 09 23:23:31 dist-test-slave-6nmv krb5kdc[24970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317811, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:31.278868 24983 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 23:23:31.279292 24983 webserver.cc:460] Webserver started at http://127.0.0.1:39293/ using document root <none> and password file <none>
I20260809 23:23:31.279528 24983 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:31.279565 24983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:31.279729 24983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:31.280660 24983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "04e194a89ed74161ad00cb662839846b"
format_stamp: "Formatted at 2026-08-09 23:23:31 on dist-test-slave-6nmv"
server_key: "0aa444b0081269598c6784f6c062d387"
server_key_iv: "e35a27778bfba5b8ad7e763544c2ea7c"
server_key_version: "encryptionkey@0"
I20260809 23:23:31.280983 24983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "04e194a89ed74161ad00cb662839846b"
format_stamp: "Formatted at 2026-08-09 23:23:31 on dist-test-slave-6nmv"
server_key: "0aa444b0081269598c6784f6c062d387"
server_key_iv: "e35a27778bfba5b8ad7e763544c2ea7c"
server_key_version: "encryptionkey@0"
I20260809 23:23:31.282282 24983 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 23:23:31.282956 25001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:31.283118 24983 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:31.283200 24983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "04e194a89ed74161ad00cb662839846b"
format_stamp: "Formatted at 2026-08-09 23:23:31 on dist-test-slave-6nmv"
server_key: "0aa444b0081269598c6784f6c062d387"
server_key_iv: "e35a27778bfba5b8ad7e763544c2ea7c"
server_key_version: "encryptionkey@0"
I20260809 23:23:31.283247 24983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:31.291081 24983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:31.292676 24983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:31.292775 24983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:31.296367 24983 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46109
I20260809 23:23:31.296422 25060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46109 every 8 connection(s)
I20260809 23:23:31.296715 24983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:31.297688 25061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:31.299775 25061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b: Bootstrap starting.
I20260809 23:23:31.300303 25061 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:31.300604 25061 log.cc:824] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:31.301254 25061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b: No bootstrap required, opened a new log
I20260809 23:23:31.302781 25061 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e194a89ed74161ad00cb662839846b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46109 } }
I20260809 23:23:31.302928 25061 raft_consensus.cc:374] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:31.302991 25061 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04e194a89ed74161ad00cb662839846b, State: Initialized, Role: FOLLOWER
I20260809 23:23:31.303143 25061 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e194a89ed74161ad00cb662839846b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46109 } }
I20260809 23:23:31.303213 25061 raft_consensus.cc:388] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:31.303248 25061 raft_consensus.cc:482] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:31.303292 25061 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:31.303761 25061 raft_consensus.cc:504] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e194a89ed74161ad00cb662839846b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46109 } }
I20260809 23:23:31.303869 25061 leader_election.cc:302] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 04e194a89ed74161ad00cb662839846b; no voters:
I20260809 23:23:31.304082 25061 leader_election.cc:288] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:31.304124 25064 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:31.304297 25064 raft_consensus.cc:686] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [term 1 LEADER]: Becoming Leader. State: Replica: 04e194a89ed74161ad00cb662839846b, State: Running, Role: LEADER
I20260809 23:23:31.304332 25061 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:31.304467 25064 consensus_queue.cc:237] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e194a89ed74161ad00cb662839846b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46109 } }
I20260809 23:23:31.304818 25065 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "04e194a89ed74161ad00cb662839846b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e194a89ed74161ad00cb662839846b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46109 } } }
I20260809 23:23:31.304823 25066 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 04e194a89ed74161ad00cb662839846b. Latest consensus state: current_term: 1 leader_uuid: "04e194a89ed74161ad00cb662839846b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "04e194a89ed74161ad00cb662839846b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46109 } } }
I20260809 23:23:31.304945 25065 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:31.304961 25066 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:31.305156 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 24983
I20260809 23:23:31.305181 25068 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:31.305308 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:31.305526 1966 external_mini_cluster.cc:1428] Setting key 208e6e9a22384373a64daedcea48f9ad
I20260809 23:23:31.305696 25068 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:31.307301 25068 catalog_manager.cc:1347] Generated new cluster ID: ca856a284aad48c99d55165468db4b5d
I20260809 23:23:31.307358 25068 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:31.311051 25078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:31.305979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50833 (local address 127.0.0.1:46109)
0809 23:23:31.306492 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:31.306500 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:31.306666 (+ 166us) server_negotiation.cc:407] Connection header received
0809 23:23:31.306933 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:31.306940 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:31.307000 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:31.307095 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:31.307447 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:31.308321 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:31.309092 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:31.309490 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:31.309599 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:31.310303 (+ 704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:31.310307 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:31.310307 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:31.310479 (+ 172us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:31.310507 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:31.310517 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:31.310591 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:31.310664 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 23:23:31.310725 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":100,"threads_started":1}
I20260809 23:23:31.312297 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:31.316597 25068 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:31.317260 25068 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:31.320919 25068 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 04e194a89ed74161ad00cb662839846b: Generated new TSK 0
I20260809 23:23:31.321064 25068 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:31.323644 25078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:31.313633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38327 (local address 127.0.0.1:46109)
0809 23:23:31.313670 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:31.313671 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:31.320931 (+ 7260us) server_negotiation.cc:407] Connection header received
0809 23:23:31.321028 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:31.321029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:31.321040 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:31.321067 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:31.321254 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:31.321719 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:31.322530 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:31.322713 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:31.322786 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:31.323413 (+ 627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:31.323414 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:31.323415 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:31.323420 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:31.323438 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:31.323442 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:31.323496 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:31.323552 (+ 56us) server_negotiation.cc:299] Negotiation successful
0809 23:23:31.323574 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 23:23:31.325524 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 24983
2026-08-09T23:23:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1289 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:31 dist-test-slave-6nmv krb5kdc[25095](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:31 dist-test-slave-6nmv krb5kdc[25095](info): set up 2 sockets
Aug 09 23:23:31 dist-test-slave-6nmv krb5kdc[25095](info): commencing operation
krb5kdc: starting...
W20260809 23:23:32.342408 1966 mini_kdc.cc:121] Time spent starting KDC: real 0.996s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:32 dist-test-slave-6nmv krb5kdc[25095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 23:23:32.456208 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41877
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41877
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:32.547037 25108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:32.547289 25108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:32.547330 25108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:32.548421 25108 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:32.548487 25108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:32.548516 25108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:32.548547 25108 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:32.548575 25108 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:32.550037 25108 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41877
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:32.550288 25108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:32.550563 25108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:32.555603 25115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:32.555619 25118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:32.555622 25116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:32.555845 25108 server_base.cc:1034] running on GCE node
I20260809 23:23:32.556057 25108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:32.556288 25108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:32.557457 25108 hybrid_clock.cc:648] HybridClock initialized: now 1786317812557446 us; error 32 us; skew 500 ppm
Aug 09 23:23:32 dist-test-slave-6nmv krb5kdc[25095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317812, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:32.559937 25108 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 23:23:32.560365 25108 webserver.cc:460] Webserver started at http://127.0.0.1:34539/ using document root <none> and password file <none>
I20260809 23:23:32.560623 25108 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:32.560689 25108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:32.560827 25108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:32.561867 25108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "0afce2570a9c4c9b8c0570da7baddc6c"
format_stamp: "Formatted at 2026-08-09 23:23:32 on dist-test-slave-6nmv"
server_key: "e79266a45017fd6d2852bee77f598247"
server_key_iv: "9e561de2c14dcd587d169cb5f4ce7953"
server_key_version: "encryptionkey@0"
I20260809 23:23:32.562378 25108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "0afce2570a9c4c9b8c0570da7baddc6c"
format_stamp: "Formatted at 2026-08-09 23:23:32 on dist-test-slave-6nmv"
server_key: "e79266a45017fd6d2852bee77f598247"
server_key_iv: "9e561de2c14dcd587d169cb5f4ce7953"
server_key_version: "encryptionkey@0"
I20260809 23:23:32.563699 25108 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:23:32.564457 25125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:32.564626 25108 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:32.564736 25108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "0afce2570a9c4c9b8c0570da7baddc6c"
format_stamp: "Formatted at 2026-08-09 23:23:32 on dist-test-slave-6nmv"
server_key: "e79266a45017fd6d2852bee77f598247"
server_key_iv: "9e561de2c14dcd587d169cb5f4ce7953"
server_key_version: "encryptionkey@0"
I20260809 23:23:32.564813 25108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:32.568022 25108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:32.569780 25108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:32.569957 25108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:32.574296 25108 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41877
I20260809 23:23:32.574323 25188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41877 every 8 connection(s)
I20260809 23:23:32.574657 25108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:32.575575 25189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:32.577497 25189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c: Bootstrap starting.
I20260809 23:23:32.578104 25189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:32.578321 25189 log.cc:824] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:32.578915 25189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c: No bootstrap required, opened a new log
I20260809 23:23:32.580240 25189 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0afce2570a9c4c9b8c0570da7baddc6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41877 } }
I20260809 23:23:32.580348 25189 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:32.580367 25189 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0afce2570a9c4c9b8c0570da7baddc6c, State: Initialized, Role: FOLLOWER
I20260809 23:23:32.580458 25189 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0afce2570a9c4c9b8c0570da7baddc6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41877 } }
I20260809 23:23:32.580502 25189 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:32.580518 25189 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:32.580540 25189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:32.580933 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 25108
I20260809 23:23:32.580946 25189 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0afce2570a9c4c9b8c0570da7baddc6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41877 } }
I20260809 23:23:32.581010 25189 leader_election.cc:302] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0afce2570a9c4c9b8c0570da7baddc6c; no voters:
I20260809 23:23:32.581111 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:32.581173 25189 leader_election.cc:288] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:32.581197 25192 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:32.581302 25192 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [term 1 LEADER]: Becoming Leader. State: Replica: 0afce2570a9c4c9b8c0570da7baddc6c, State: Running, Role: LEADER
I20260809 23:23:32.581338 1966 external_mini_cluster.cc:1428] Setting key cdb84c8e7a3dd747027894cd5573a86d
I20260809 23:23:32.581418 25189 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:32.581426 25192 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0afce2570a9c4c9b8c0570da7baddc6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41877 } }
I20260809 23:23:32.582139 25194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0afce2570a9c4c9b8c0570da7baddc6c. Latest consensus state: current_term: 1 leader_uuid: "0afce2570a9c4c9b8c0570da7baddc6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0afce2570a9c4c9b8c0570da7baddc6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41877 } } }
I20260809 23:23:32.582391 25194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:32.582151 25193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0afce2570a9c4c9b8c0570da7baddc6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0afce2570a9c4c9b8c0570da7baddc6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41877 } } }
I20260809 23:23:32.582537 25193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:32.583253 25204 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:32.583926 25196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:32.581760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37043 (local address 127.0.0.1:41877)
0809 23:23:32.582139 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:32.582148 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:32.582178 (+ 30us) server_negotiation.cc:407] Connection header received
0809 23:23:32.582278 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:32.582285 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:32.582314 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:32.582474 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:32.583476 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:32.583497 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:32.583497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:32.583501 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:32.583564 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:32.583579 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:32.583650 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:32.583720 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 23:23:32.583759 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":75,"threads_started":1}
I20260809 23:23:32.583935 25204 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:32.584858 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:32.585570 25204 catalog_manager.cc:1347] Generated new cluster ID: 8c8da7f3bc0741acb3bde521bab3660e
I20260809 23:23:32.585615 25204 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:32.587352 25196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:32.586302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59005 (local address 127.0.0.1:41877)
0809 23:23:32.586333 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:32.586335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:32.586501 (+ 166us) server_negotiation.cc:407] Connection header received
0809 23:23:32.586541 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:32.586542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:32.586546 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:32.586605 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:32.587162 (+ 557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:32.587164 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:32.587164 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:32.587167 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:32.587181 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:32.587184 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:32.587241 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:32.587289 (+ 48us) server_negotiation.cc:299] Negotiation successful
0809 23:23:32.587300 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 23:23:32.590404 25204 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:32.590569 25204 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:32.593077 25204 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0afce2570a9c4c9b8c0570da7baddc6c: Generated new TSK 0
I20260809 23:23:32.593214 25204 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:32.599166 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 25108
2026-08-09T23:23:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1274 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:32 dist-test-slave-6nmv krb5kdc[25222](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:32 dist-test-slave-6nmv krb5kdc[25222](info): set up 2 sockets
Aug 09 23:23:32 dist-test-slave-6nmv krb5kdc[25222](info): commencing operation
krb5kdc: starting...
W20260809 23:23:33.610695 1966 mini_kdc.cc:121] Time spent starting KDC: real 0.990s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:33 dist-test-slave-6nmv krb5kdc[25222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 23:23:33.719895 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41111
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41903
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41111
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:33.794824 25236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:33.795017 25236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:33.795039 25236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:33.796129 25236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:33.796168 25236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:33.796181 25236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:33.796228 25236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:33.796254 25236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:33.797561 25236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41903
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:33.797791 25236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:33.798049 25236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:33.802513 25241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:33.802522 25236 server_base.cc:1034] running on GCE node
W20260809 23:23:33.802495 25242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:33.802513 25244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:33.803017 25236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:33.803290 25236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:33.804443 25236 hybrid_clock.cc:648] HybridClock initialized: now 1786317813804441 us; error 38 us; skew 500 ppm
Aug 09 23:23:33 dist-test-slave-6nmv krb5kdc[25222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317813, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:33.813371 25236 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 23:23:33.813750 25236 webserver.cc:460] Webserver started at http://127.0.0.1:36473/ using document root <none> and password file <none>
I20260809 23:23:33.813992 25236 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:33.814035 25236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:33.814116 25236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:33.815097 25236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "d2ab77ea7f7d4f9998091a14937bf79a"
format_stamp: "Formatted at 2026-08-09 23:23:33 on dist-test-slave-6nmv"
server_key: "0cf853e96e2e537d5c3fcfd67fca6493"
server_key_iv: "a2a383885d46921ddf522eaa3d0e9fe5"
server_key_version: "encryptionkey@0"
I20260809 23:23:33.815392 25236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "d2ab77ea7f7d4f9998091a14937bf79a"
format_stamp: "Formatted at 2026-08-09 23:23:33 on dist-test-slave-6nmv"
server_key: "0cf853e96e2e537d5c3fcfd67fca6493"
server_key_iv: "a2a383885d46921ddf522eaa3d0e9fe5"
server_key_version: "encryptionkey@0"
I20260809 23:23:33.816560 25236 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260809 23:23:33.817186 25251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:33.817351 25236 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:23:33.817436 25236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "d2ab77ea7f7d4f9998091a14937bf79a"
format_stamp: "Formatted at 2026-08-09 23:23:33 on dist-test-slave-6nmv"
server_key: "0cf853e96e2e537d5c3fcfd67fca6493"
server_key_iv: "a2a383885d46921ddf522eaa3d0e9fe5"
server_key_version: "encryptionkey@0"
I20260809 23:23:33.817505 25236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:33.838119 25236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:33.839740 25236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:33.839905 25236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:33.843647 25236 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41111
I20260809 23:23:33.843694 25307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41111 every 8 connection(s)
I20260809 23:23:33.844023 25236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:33.844307 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 25236
I20260809 23:23:33.844467 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:33.844664 1966 external_mini_cluster.cc:1428] Setting key 26d279c3440479577615e5fc55e04eb9
I20260809 23:23:33.845273 25308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:33.848393 25308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a: Bootstrap starting.
I20260809 23:23:33.849017 25308 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:33.849313 25308 log.cc:824] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:33.850091 25308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a: No bootstrap required, opened a new log
Aug 09 23:23:33 dist-test-slave-6nmv krb5kdc[25222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 23:23:33.852192 25308 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2ab77ea7f7d4f9998091a14937bf79a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41111 } }
I20260809 23:23:33.852361 25308 raft_consensus.cc:374] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:33.852415 25308 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2ab77ea7f7d4f9998091a14937bf79a, State: Initialized, Role: FOLLOWER
I20260809 23:23:33.852574 25308 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2ab77ea7f7d4f9998091a14937bf79a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41111 } }
I20260809 23:23:33.852670 25308 raft_consensus.cc:388] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:33.852705 25308 raft_consensus.cc:482] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:33.852759 25308 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:33.853480 25308 raft_consensus.cc:504] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2ab77ea7f7d4f9998091a14937bf79a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41111 } }
I20260809 23:23:33.853583 25308 leader_election.cc:302] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2ab77ea7f7d4f9998091a14937bf79a; no voters:
I20260809 23:23:33.853741 25308 leader_election.cc:288] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:33.853794 25314 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:33.853958 25314 raft_consensus.cc:686] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [term 1 LEADER]: Becoming Leader. State: Replica: d2ab77ea7f7d4f9998091a14937bf79a, State: Running, Role: LEADER
I20260809 23:23:33.854007 25308 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:33.854446 25314 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2ab77ea7f7d4f9998091a14937bf79a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41111 } }
I20260809 23:23:33.854805 25315 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d2ab77ea7f7d4f9998091a14937bf79a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2ab77ea7f7d4f9998091a14937bf79a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41111 } } }
I20260809 23:23:33.854826 25317 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2ab77ea7f7d4f9998091a14937bf79a. Latest consensus state: current_term: 1 leader_uuid: "d2ab77ea7f7d4f9998091a14937bf79a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2ab77ea7f7d4f9998091a14937bf79a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41111 } } }
I20260809 23:23:33.854983 25317 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:33.854964 25315 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:33.855207 25324 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:33.855746 25324 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:33.856091 25312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:33.845172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:44457 (local address 127.0.0.1:41111)
0809 23:23:33.845384 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:33.845393 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:33.845425 (+ 32us) server_negotiation.cc:407] Connection header received
0809 23:23:33.846048 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:33.846057 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:33.846121 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:33.846268 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:33.846836 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:33.848121 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:33.848877 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:33.849443 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:33.849554 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:33.851940 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:33.851944 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:33.851944 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:33.851956 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:33.853960 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:33.854376 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:33.854379 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:33.854379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:33.854487 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:33.854770 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:33.854772 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:33.854772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:33.855091 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:33.855249 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:33.855788 (+ 539us) server_negotiation.cc:299] Negotiation successful
0809 23:23:33.855881 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":109,"threads_started":1}
I20260809 23:23:33.856923 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:33.862186 25324 catalog_manager.cc:1347] Generated new cluster ID: a26afe6509c54128a16751482b7da55b
I20260809 23:23:33.862236 25324 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:33.863909 25312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:33.858272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:45521 (local address 127.0.0.1:41111)
0809 23:23:33.858307 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:33.858308 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:33.858431 (+ 123us) server_negotiation.cc:407] Connection header received
0809 23:23:33.858452 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:33.858453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:33.858462 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:33.858526 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:33.858943 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:33.859588 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:33.860209 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:33.860512 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:33.860590 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:33.861599 (+ 1009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:33.861600 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:33.861600 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:33.861606 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:33.863004 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:33.863307 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:33.863308 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:33.863308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:33.863357 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:33.863524 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:33.863524 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:33.863525 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:33.863621 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:33.863699 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:33.863781 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 23:23:33.863831 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 23:23:33.875644 25324 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:33.876060 25324 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:33.880874 25324 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d2ab77ea7f7d4f9998091a14937bf79a: Generated new TSK 0
I20260809 23:23:33.881053 25324 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:33.890012 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 25236
W20260809 23:23:33.897274 25220 connection.cc:535] client connection to 127.0.0.1:41111 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41111): Connection reset by peer (error 104)
2026-08-09T23:23:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1290 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:33 dist-test-slave-6nmv krb5kdc[25345](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:33 dist-test-slave-6nmv krb5kdc[25345](info): set up 2 sockets
Aug 09 23:23:33 dist-test-slave-6nmv krb5kdc[25345](info): commencing operation
krb5kdc: starting...
W20260809 23:23:34.906365 1966 mini_kdc.cc:121] Time spent starting KDC: real 0.995s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:34 dist-test-slave-6nmv krb5kdc[25345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 23:23:35.020975 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36679
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36679
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:35.100059 25359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:35.100261 25359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:35.100303 25359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:35.101392 25359 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:35.101456 25359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:35.101483 25359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:35.101513 25359 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:35.101536 25359 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:35.102991 25359 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:35.103251 25359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:35.103468 25359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:35.108119 25366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:35.108126 25367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:35.108166 25359 server_base.cc:1034] running on GCE node
W20260809 23:23:35.108166 25370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:35.108601 25359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:35.108839 25359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:35.109975 25359 hybrid_clock.cc:648] HybridClock initialized: now 1786317815109963 us; error 31 us; skew 500 ppm
Aug 09 23:23:35 dist-test-slave-6nmv krb5kdc[25345](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317815, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:35.112293 25359 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 23:23:35.112716 25359 webserver.cc:460] Webserver started at http://127.0.0.1:34913/ using document root <none> and password file <none>
I20260809 23:23:35.112919 25359 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:35.112957 25359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:35.113042 25359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:35.114038 25359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "621445ff67a24dd3b395550f3cdb3091"
format_stamp: "Formatted at 2026-08-09 23:23:35 on dist-test-slave-6nmv"
server_key: "a8d2f37455c71d5160c4e38b0d8f97e2"
server_key_iv: "69cc10ea7b33e508f26bc57f9ecc69c6"
server_key_version: "encryptionkey@0"
I20260809 23:23:35.114307 25359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "621445ff67a24dd3b395550f3cdb3091"
format_stamp: "Formatted at 2026-08-09 23:23:35 on dist-test-slave-6nmv"
server_key: "a8d2f37455c71d5160c4e38b0d8f97e2"
server_key_iv: "69cc10ea7b33e508f26bc57f9ecc69c6"
server_key_version: "encryptionkey@0"
I20260809 23:23:35.115530 25359 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:23:35.116144 25377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:35.116348 25359 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:35.116434 25359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "621445ff67a24dd3b395550f3cdb3091"
format_stamp: "Formatted at 2026-08-09 23:23:35 on dist-test-slave-6nmv"
server_key: "a8d2f37455c71d5160c4e38b0d8f97e2"
server_key_iv: "69cc10ea7b33e508f26bc57f9ecc69c6"
server_key_version: "encryptionkey@0"
I20260809 23:23:35.116487 25359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:35.124946 25359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:35.127185 25359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:35.127287 25359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:35.130883 25359 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36679
I20260809 23:23:35.130944 25434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36679 every 8 connection(s)
I20260809 23:23:35.131246 25359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:35.132174 25435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:35.134418 25435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091: Bootstrap starting.
I20260809 23:23:35.134977 25435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:35.135268 25435 log.cc:824] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:35.135313 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 25359
I20260809 23:23:35.135438 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:35.135667 1966 external_mini_cluster.cc:1428] Setting key 82f8d95e7fed377b4aeec9a127a5bdc8
I20260809 23:23:35.136075 25435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091: No bootstrap required, opened a new log
I20260809 23:23:35.137688 25435 raft_consensus.cc:348] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "621445ff67a24dd3b395550f3cdb3091" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36679 } }
I20260809 23:23:35.137850 25435 raft_consensus.cc:374] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:35.137948 25435 raft_consensus.cc:729] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 621445ff67a24dd3b395550f3cdb3091, State: Initialized, Role: FOLLOWER
I20260809 23:23:35.138082 25435 consensus_queue.cc:260] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "621445ff67a24dd3b395550f3cdb3091" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36679 } }
I20260809 23:23:35.138165 25435 raft_consensus.cc:388] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:35.138212 25435 raft_consensus.cc:482] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:35.138252 25435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:35.138921 25435 raft_consensus.cc:504] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "621445ff67a24dd3b395550f3cdb3091" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36679 } }
I20260809 23:23:35.139022 25435 leader_election.cc:302] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 621445ff67a24dd3b395550f3cdb3091; no voters:
I20260809 23:23:35.139170 25435 leader_election.cc:288] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:35.139230 25441 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:35.139379 25435 sys_catalog.cc:564] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:35.139394 25441 raft_consensus.cc:686] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [term 1 LEADER]: Becoming Leader. State: Replica: 621445ff67a24dd3b395550f3cdb3091, State: Running, Role: LEADER
I20260809 23:23:35.139477 25441 consensus_queue.cc:237] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "621445ff67a24dd3b395550f3cdb3091" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36679 } }
I20260809 23:23:35.139829 25441 sys_catalog.cc:455] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 621445ff67a24dd3b395550f3cdb3091. Latest consensus state: current_term: 1 leader_uuid: "621445ff67a24dd3b395550f3cdb3091" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "621445ff67a24dd3b395550f3cdb3091" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36679 } } }
I20260809 23:23:35.140054 25441 sys_catalog.cc:458] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:35.139994 25442 sys_catalog.cc:455] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "621445ff67a24dd3b395550f3cdb3091" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "621445ff67a24dd3b395550f3cdb3091" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36679 } } }
I20260809 23:23:35.140457 25442 sys_catalog.cc:458] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:35.140601 25454 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:35.141053 25454 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:35.142494 25454 catalog_manager.cc:1347] Generated new cluster ID: 678504564e6041db8c84c53a5e572ea3
I20260809 23:23:35.142549 25454 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:35.143072 25439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:35.136141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:33003 (local address 127.0.0.1:36679)
0809 23:23:35.136312 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:35.136319 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:35.136347 (+ 28us) server_negotiation.cc:407] Connection header received
0809 23:23:35.137676 (+ 1329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:35.137681 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:35.137724 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:35.137864 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:35.138087 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:35.139683 (+ 1596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:35.140769 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:35.141330 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:35.141420 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:35.142371 (+ 951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:35.142375 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:35.142375 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:35.142594 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:35.142636 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:35.142650 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:35.142758 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:35.142839 (+ 81us) server_negotiation.cc:299] Negotiation successful
0809 23:23:35.142867 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
I20260809 23:23:35.144007 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:35.148172 25439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:35.145244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:59661 (local address 127.0.0.1:36679)
0809 23:23:35.145278 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:35.145280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:35.145347 (+ 67us) server_negotiation.cc:407] Connection header received
0809 23:23:35.145399 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:35.145399 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:35.145406 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:35.145453 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:35.145570 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:35.146057 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:35.147067 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:35.147257 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:35.147315 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:35.147923 (+ 608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:35.147925 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:35.147925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:35.147930 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:35.147946 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:35.147950 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:35.148013 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:35.148084 (+ 71us) server_negotiation.cc:299] Negotiation successful
0809 23:23:35.148096 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 23:23:35.154953 25454 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:35.155591 25454 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:35.160619 25454 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 621445ff67a24dd3b395550f3cdb3091: Generated new TSK 0
I20260809 23:23:35.160779 25454 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:35.168098 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 25359
W20260809 23:23:35.176345 25343 connection.cc:535] client connection to 127.0.0.1:36679 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36679): Connection reset by peer (error 104)
2026-08-09T23:23:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1278 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:35 dist-test-slave-6nmv krb5kdc[25471](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:35 dist-test-slave-6nmv krb5kdc[25471](info): set up 2 sockets
Aug 09 23:23:35 dist-test-slave-6nmv krb5kdc[25471](info): commencing operation
krb5kdc: starting...
W20260809 23:23:36.197163 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.007s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:36 dist-test-slave-6nmv krb5kdc[25471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317816, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 23:23:36.310087 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45759
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45759
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:36.388031 25486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:36.388211 25486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:36.388229 25486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:36.389276 25486 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:36.389317 25486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:36.389328 25486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:36.389361 25486 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:36.389386 25486 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:36.390638 25486 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45759
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25486
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:36.390883 25486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:36.391090 25486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:36.395622 25492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:36.395601 25495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:36.395663 25486 server_base.cc:1034] running on GCE node
W20260809 23:23:36.395610 25493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:36.396050 25486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:36.396368 25486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:36.397527 25486 hybrid_clock.cc:648] HybridClock initialized: now 1786317816397511 us; error 42 us; skew 500 ppm
Aug 09 23:23:36 dist-test-slave-6nmv krb5kdc[25471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317816, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:36.399715 25486 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 23:23:36.400142 25486 webserver.cc:460] Webserver started at http://127.0.0.1:34557/ using document root <none> and password file <none>
I20260809 23:23:36.400422 25486 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:36.400487 25486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:36.400609 25486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:36.401521 25486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "80a924a6d4b7478499cc028feab78c71"
format_stamp: "Formatted at 2026-08-09 23:23:36 on dist-test-slave-6nmv"
server_key: "d4bc29cc457bad27ad57bfc6d2518484"
server_key_iv: "33d4d8660293cae3cc78bda4a717fa37"
server_key_version: "encryptionkey@0"
I20260809 23:23:36.401928 25486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "80a924a6d4b7478499cc028feab78c71"
format_stamp: "Formatted at 2026-08-09 23:23:36 on dist-test-slave-6nmv"
server_key: "d4bc29cc457bad27ad57bfc6d2518484"
server_key_iv: "33d4d8660293cae3cc78bda4a717fa37"
server_key_version: "encryptionkey@0"
I20260809 23:23:36.403144 25486 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:23:36.403855 25502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:36.404028 25486 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:36.404110 25486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "80a924a6d4b7478499cc028feab78c71"
format_stamp: "Formatted at 2026-08-09 23:23:36 on dist-test-slave-6nmv"
server_key: "d4bc29cc457bad27ad57bfc6d2518484"
server_key_iv: "33d4d8660293cae3cc78bda4a717fa37"
server_key_version: "encryptionkey@0"
I20260809 23:23:36.404194 25486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:36.407361 25486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:36.409052 25486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:36.409199 25486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:36.413051 25486 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45759
I20260809 23:23:36.413144 25558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45759 every 8 connection(s)
I20260809 23:23:36.413445 25486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:36.414034 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 25486
I20260809 23:23:36.414177 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:36.414372 1966 external_mini_cluster.cc:1428] Setting key fe9603e66f51870d877d95ecf87baeae
I20260809 23:23:36.414556 25559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:36.416795 25562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:36.414857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:39109 (local address 127.0.0.1:45759)
0809 23:23:36.415091 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:36.415099 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:36.415136 (+ 37us) server_negotiation.cc:407] Connection header received
0809 23:23:36.415697 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:36.415704 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:36.415733 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:36.415860 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:36.416418 (+ 558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:36.416422 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:36.416422 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:36.416427 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:36.416468 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:36.416480 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:36.416548 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:36.416595 (+ 47us) server_negotiation.cc:299] Negotiation successful
0809 23:23:36.416630 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":127,"threads_started":1}
I20260809 23:23:36.417727 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:36.417945 25559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71: Bootstrap starting.
I20260809 23:23:36.418481 25559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:36.418799 25559 log.cc:824] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:36.419552 25559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71: No bootstrap required, opened a new log
I20260809 23:23:36.420038 25562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:36.419023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:35187 (local address 127.0.0.1:45759)
0809 23:23:36.419054 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:36.419056 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:36.419182 (+ 126us) server_negotiation.cc:407] Connection header received
0809 23:23:36.419251 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:36.419252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:36.419255 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:36.419316 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:36.419816 (+ 500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:36.419817 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:36.419817 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:36.419821 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:36.419831 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:36.419834 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:36.419881 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:36.419946 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 23:23:36.419958 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 23:23:36.421293 25559 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a924a6d4b7478499cc028feab78c71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45759 } }
I20260809 23:23:36.421427 25559 raft_consensus.cc:374] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:36.421471 25559 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80a924a6d4b7478499cc028feab78c71, State: Initialized, Role: FOLLOWER
I20260809 23:23:36.421598 25559 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a924a6d4b7478499cc028feab78c71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45759 } }
I20260809 23:23:36.421682 25559 raft_consensus.cc:388] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:36.421733 25559 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:36.421774 25559 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:36.422283 25559 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a924a6d4b7478499cc028feab78c71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45759 } }
I20260809 23:23:36.422391 25559 leader_election.cc:302] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 80a924a6d4b7478499cc028feab78c71; no voters:
I20260809 23:23:36.422561 25559 leader_election.cc:288] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:36.422600 25569 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:36.422742 25569 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [term 1 LEADER]: Becoming Leader. State: Replica: 80a924a6d4b7478499cc028feab78c71, State: Running, Role: LEADER
I20260809 23:23:36.422803 25559 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:36.422819 25569 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a924a6d4b7478499cc028feab78c71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45759 } }
I20260809 23:23:36.423236 25570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "80a924a6d4b7478499cc028feab78c71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a924a6d4b7478499cc028feab78c71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45759 } } }
I20260809 23:23:36.423344 25570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:36.423570 25571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80a924a6d4b7478499cc028feab78c71. Latest consensus state: current_term: 1 leader_uuid: "80a924a6d4b7478499cc028feab78c71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "80a924a6d4b7478499cc028feab78c71" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45759 } } }
I20260809 23:23:36.423646 25571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:36.423802 25581 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:36.424243 25581 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:36.425710 25581 catalog_manager.cc:1347] Generated new cluster ID: 8e4733ffa7be46eabc45c32fe6af0575
I20260809 23:23:36.425774 25581 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:36.439919 25581 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:36.440088 25581 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:36.443745 25581 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80a924a6d4b7478499cc028feab78c71: Generated new TSK 0
I20260809 23:23:36.443986 25581 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:36.451536 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 25486
2026-08-09T23:23:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1280 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:36 dist-test-slave-6nmv krb5kdc[25596](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:36 dist-test-slave-6nmv krb5kdc[25596](info): set up 2 sockets
Aug 09 23:23:36 dist-test-slave-6nmv krb5kdc[25596](info): commencing operation
krb5kdc: starting...
W20260809 23:23:37.469440 1966 mini_kdc.cc:121] Time spent starting KDC: real 0.999s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:37 dist-test-slave-6nmv krb5kdc[25596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 23:23:37.578343 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41431
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41431
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:37.651871 25609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:37.652066 25609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:37.652088 25609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:37.653172 25609 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:37.653208 25609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:37.653220 25609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:37.653249 25609 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:37.653259 25609 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:37.654600 25609 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41431
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:37.654830 25609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:37.655068 25609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:37.659788 25619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:37.659801 25617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:37.659873 25609 server_base.cc:1034] running on GCE node
W20260809 23:23:37.659797 25616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:37.660288 25609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:37.660550 25609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:37.661708 25609 hybrid_clock.cc:648] HybridClock initialized: now 1786317817661690 us; error 34 us; skew 500 ppm
Aug 09 23:23:37 dist-test-slave-6nmv krb5kdc[25596](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317817, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:37.664067 25609 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 23:23:37.664480 25609 webserver.cc:460] Webserver started at http://127.0.0.1:43491/ using document root <none> and password file <none>
I20260809 23:23:37.664723 25609 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:37.664790 25609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:37.664937 25609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:37.665977 25609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "4cdcb2dc94b9486f9bfc0eced5c5bae9"
format_stamp: "Formatted at 2026-08-09 23:23:37 on dist-test-slave-6nmv"
server_key: "5bd112b7e98661f55b24067ce3687570"
server_key_iv: "8dbe45f23e9835cdf146a70903b2d953"
server_key_version: "encryptionkey@0"
I20260809 23:23:37.666277 25609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "4cdcb2dc94b9486f9bfc0eced5c5bae9"
format_stamp: "Formatted at 2026-08-09 23:23:37 on dist-test-slave-6nmv"
server_key: "5bd112b7e98661f55b24067ce3687570"
server_key_iv: "8dbe45f23e9835cdf146a70903b2d953"
server_key_version: "encryptionkey@0"
I20260809 23:23:37.667410 25609 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:23:37.668071 25626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:37.668262 25609 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:23:37.668357 25609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "4cdcb2dc94b9486f9bfc0eced5c5bae9"
format_stamp: "Formatted at 2026-08-09 23:23:37 on dist-test-slave-6nmv"
server_key: "5bd112b7e98661f55b24067ce3687570"
server_key_iv: "8dbe45f23e9835cdf146a70903b2d953"
server_key_version: "encryptionkey@0"
I20260809 23:23:37.668430 25609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:37.684695 25609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:37.686949 25609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:37.687109 25609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:37.690874 25609 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41431
I20260809 23:23:37.690927 25682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41431 every 8 connection(s)
I20260809 23:23:37.691236 25609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:37.692111 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 25609
I20260809 23:23:37.692200 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:37.692202 25683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:37.692391 1966 external_mini_cluster.cc:1428] Setting key 71fb389dc3ac4bdf710e2c56c9425f5a
I20260809 23:23:37.695442 25683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9: Bootstrap starting.
I20260809 23:23:37.696113 25683 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:37.696372 25683 log.cc:824] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:37.697058 25683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9: No bootstrap required, opened a new log
I20260809 23:23:37.698935 25683 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cdcb2dc94b9486f9bfc0eced5c5bae9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } }
I20260809 23:23:37.699070 25683 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:37.699115 25683 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cdcb2dc94b9486f9bfc0eced5c5bae9, State: Initialized, Role: FOLLOWER
Aug 09 23:23:37 dist-test-slave-6nmv krb5kdc[25596](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 23:23:37.699306 25683 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cdcb2dc94b9486f9bfc0eced5c5bae9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } }
I20260809 23:23:37.699383 25683 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:37.699443 25683 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:37.699491 25683 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:37.700155 25683 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cdcb2dc94b9486f9bfc0eced5c5bae9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } }
I20260809 23:23:37.700263 25683 leader_election.cc:302] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4cdcb2dc94b9486f9bfc0eced5c5bae9; no voters:
I20260809 23:23:37.700426 25683 leader_election.cc:288] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:37.700513 25689 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:37.700666 25689 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [term 1 LEADER]: Becoming Leader. State: Replica: 4cdcb2dc94b9486f9bfc0eced5c5bae9, State: Running, Role: LEADER
I20260809 23:23:37.700744 25683 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:37.701094 25689 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cdcb2dc94b9486f9bfc0eced5c5bae9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } }
I20260809 23:23:37.701581 25691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4cdcb2dc94b9486f9bfc0eced5c5bae9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cdcb2dc94b9486f9bfc0eced5c5bae9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } } }
I20260809 23:23:37.701686 25691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:37.702273 25690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cdcb2dc94b9486f9bfc0eced5c5bae9. Latest consensus state: current_term: 1 leader_uuid: "4cdcb2dc94b9486f9bfc0eced5c5bae9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cdcb2dc94b9486f9bfc0eced5c5bae9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41431 } } }
I20260809 23:23:37.702575 25690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9 [sys.catalog]: This master's current role is: LEADER
W20260809 23:23:37.702976 25708 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 23:23:37.703028 25708 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:23:37.703119 25700 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:37.703356 25700 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:37.704490 25687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:37.692845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:33559 (local address 127.0.0.1:41431)
0809 23:23:37.693045 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:37.693053 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:37.693084 (+ 31us) server_negotiation.cc:407] Connection header received
0809 23:23:37.693700 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:37.693709 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:37.693781 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:37.693944 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:37.694438 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:37.695806 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:37.696532 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:37.697029 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:37.697176 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:37.699779 (+ 2603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:37.699783 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:37.699783 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:37.699794 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:37.702246 (+ 2452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:37.702912 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:37.702914 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:37.702915 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:37.703010 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:37.703324 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:37.703324 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:37.703325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:37.703620 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:37.703821 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:37.704187 (+ 366us) server_negotiation.cc:299] Negotiation successful
0809 23:23:37.704279 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":94,"threads_started":1}
I20260809 23:23:37.705053 25700 catalog_manager.cc:1347] Generated new cluster ID: bde71c922adf4b41a71075967e766e57
I20260809 23:23:37.705156 25700 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:37.705687 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:37.725615 25687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:37.718158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:50555 (local address 127.0.0.1:41431)
0809 23:23:37.718192 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:37.718193 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:37.718337 (+ 144us) server_negotiation.cc:407] Connection header received
0809 23:23:37.718398 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:37.718399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:37.718410 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:37.718467 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:37.719103 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:37.719851 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:37.720902 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:37.721216 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:37.721278 (+ 62us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:37.722716 (+ 1438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:37.722718 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:37.722718 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:37.722724 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:37.724298 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:37.724768 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:37.724769 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:37.724769 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:37.724832 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:37.725080 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:37.725081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:37.725081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:37.725203 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:37.725317 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:37.725456 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 23:23:37.725520 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 23:23:37.731520 25700 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:37.732029 25700 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:37.736344 25700 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4cdcb2dc94b9486f9bfc0eced5c5bae9: Generated new TSK 0
I20260809 23:23:37.736512 25700 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:37.741003 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 25609
W20260809 23:23:37.749063 25594 connection.cc:535] client connection to 127.0.0.1:41431 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41431): Connection reset by peer (error 104)
2026-08-09T23:23:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1292 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:37 dist-test-slave-6nmv krb5kdc[25720](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:37 dist-test-slave-6nmv krb5kdc[25720](info): set up 2 sockets
Aug 09 23:23:37 dist-test-slave-6nmv krb5kdc[25720](info): commencing operation
krb5kdc: starting...
W20260809 23:23:38.776446 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.014s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:38 dist-test-slave-6nmv krb5kdc[25720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 23:23:38.886086 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35623
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35623
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:38.960325 25734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:38.960492 25734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:38.960512 25734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:38.961488 25734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:38.961524 25734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:38.961536 25734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:38.961584 25734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:38.961599 25734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:38.962837 25734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35623
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:38.963048 25734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:38.963249 25734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:38.967748 25740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:38.967742 25739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:38.967741 25743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:38.967818 25734 server_base.cc:1034] running on GCE node
I20260809 23:23:38.968221 25734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:38.968466 25734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:38.969612 25734 hybrid_clock.cc:648] HybridClock initialized: now 1786317818969602 us; error 28 us; skew 500 ppm
Aug 09 23:23:38 dist-test-slave-6nmv krb5kdc[25720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317818, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:38.976934 25734 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 23:23:38.977363 25734 webserver.cc:460] Webserver started at http://127.0.0.1:43117/ using document root <none> and password file <none>
I20260809 23:23:38.977579 25734 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:38.977643 25734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:38.977782 25734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:38.978722 25734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "f99dc5c474374c1d8101efa501494245"
format_stamp: "Formatted at 2026-08-09 23:23:38 on dist-test-slave-6nmv"
server_key: "cb5028534cc3cce42daba20ccd08691f"
server_key_iv: "6ce7cc60f088807cc5e6dce5e430a824"
server_key_version: "encryptionkey@0"
I20260809 23:23:38.979044 25734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "f99dc5c474374c1d8101efa501494245"
format_stamp: "Formatted at 2026-08-09 23:23:38 on dist-test-slave-6nmv"
server_key: "cb5028534cc3cce42daba20ccd08691f"
server_key_iv: "6ce7cc60f088807cc5e6dce5e430a824"
server_key_version: "encryptionkey@0"
I20260809 23:23:38.980232 25734 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 23:23:38.980899 25750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:38.981066 25734 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:38.981153 25734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "f99dc5c474374c1d8101efa501494245"
format_stamp: "Formatted at 2026-08-09 23:23:38 on dist-test-slave-6nmv"
server_key: "cb5028534cc3cce42daba20ccd08691f"
server_key_iv: "6ce7cc60f088807cc5e6dce5e430a824"
server_key_version: "encryptionkey@0"
I20260809 23:23:38.981222 25734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:38.992929 25734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:38.994961 25734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:38.995123 25734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:38.999104 25734 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35623
I20260809 23:23:38.999141 25804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35623 every 8 connection(s)
I20260809 23:23:38.999442 25734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:38.999938 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 25734
I20260809 23:23:39.000056 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:39.000242 1966 external_mini_cluster.cc:1428] Setting key e17a027966e9e6ce07818826e7224335
I20260809 23:23:39.000330 25805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:39.003804 25805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245: Bootstrap starting.
I20260809 23:23:39.004483 25805 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:39.004864 25805 log.cc:824] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:39.005651 25805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245: No bootstrap required, opened a new log
I20260809 23:23:39.006115 25808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:39.000705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:42051 (local address 127.0.0.1:35623)
0809 23:23:39.000923 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:39.000931 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:39.000975 (+ 44us) server_negotiation.cc:407] Connection header received
0809 23:23:39.001508 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:39.001516 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:39.001577 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:39.001721 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:39.001956 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:39.003306 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:39.004118 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:39.004722 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:39.004866 (+ 144us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:39.005480 (+ 614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:39.005485 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:39.005485 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:39.005650 (+ 165us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:39.005676 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:39.005686 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:39.005779 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:39.005922 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 23:23:39.005958 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":100,"threads_started":1}
I20260809 23:23:39.006994 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:39.008035 25805 raft_consensus.cc:348] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f99dc5c474374c1d8101efa501494245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35623 } }
I20260809 23:23:39.008176 25805 raft_consensus.cc:374] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:39.008255 25805 raft_consensus.cc:729] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f99dc5c474374c1d8101efa501494245, State: Initialized, Role: FOLLOWER
I20260809 23:23:39.008425 25805 consensus_queue.cc:260] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f99dc5c474374c1d8101efa501494245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35623 } }
I20260809 23:23:39.008522 25805 raft_consensus.cc:388] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:39.008582 25805 raft_consensus.cc:482] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:39.008641 25805 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:39.009236 25805 raft_consensus.cc:504] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f99dc5c474374c1d8101efa501494245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35623 } }
I20260809 23:23:39.009342 25805 leader_election.cc:302] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f99dc5c474374c1d8101efa501494245; no voters:
I20260809 23:23:39.009506 25805 leader_election.cc:288] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:39.009545 25817 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:39.009696 25817 raft_consensus.cc:686] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [term 1 LEADER]: Becoming Leader. State: Replica: f99dc5c474374c1d8101efa501494245, State: Running, Role: LEADER
I20260809 23:23:39.009750 25805 sys_catalog.cc:564] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:39.009892 25817 consensus_queue.cc:237] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f99dc5c474374c1d8101efa501494245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35623 } }
I20260809 23:23:39.010213 25817 sys_catalog.cc:455] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f99dc5c474374c1d8101efa501494245. Latest consensus state: current_term: 1 leader_uuid: "f99dc5c474374c1d8101efa501494245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f99dc5c474374c1d8101efa501494245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35623 } } }
I20260809 23:23:39.010324 25817 sys_catalog.cc:458] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:39.010579 25826 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:39.010831 25819 sys_catalog.cc:455] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f99dc5c474374c1d8101efa501494245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f99dc5c474374c1d8101efa501494245" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35623 } } }
I20260809 23:23:39.011240 25819 sys_catalog.cc:458] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:39.011445 25808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:39.008223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:52241 (local address 127.0.0.1:35623)
0809 23:23:39.008254 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:39.008255 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:39.008382 (+ 127us) server_negotiation.cc:407] Connection header received
0809 23:23:39.008477 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:39.008478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:39.008485 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:39.008530 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:39.008702 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:39.009092 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:39.010042 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:39.010326 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:39.010393 (+ 67us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:39.011039 (+ 646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:39.011040 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:39.011040 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:39.011044 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:39.011056 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:39.011060 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:39.011114 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:39.011367 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 23:23:39.011377 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 23:23:39.011857 25826 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:39.013304 25826 catalog_manager.cc:1347] Generated new cluster ID: ffd42f969f644f80a9aec307cf4f9a7a
I20260809 23:23:39.013360 25826 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:39.032279 25826 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:39.033020 25826 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:39.040591 25826 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f99dc5c474374c1d8101efa501494245: Generated new TSK 0
I20260809 23:23:39.040787 25826 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:39.049341 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 25734
W20260809 23:23:39.056959 25718 connection.cc:535] client connection to 127.0.0.1:35623 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35623): Connection reset by peer (error 104)
2026-08-09T23:23:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1308 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:39 dist-test-slave-6nmv krb5kdc[25840](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:39 dist-test-slave-6nmv krb5kdc[25840](info): set up 2 sockets
Aug 09 23:23:39 dist-test-slave-6nmv krb5kdc[25840](info): commencing operation
krb5kdc: starting...
W20260809 23:23:40.080145 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.009s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:40 dist-test-slave-6nmv krb5kdc[25840](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317820, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 23:23:40.193935 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35005
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41359
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35005
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:40.268923 25854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:40.269099 25854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:40.269119 25854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:40.270246 25854 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:40.270282 25854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:40.270295 25854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:40.270306 25854 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:40.270318 25854 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:40.271708 25854 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41359
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35005
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:40.271883 25854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:40.272030 25854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:40.276502 25861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:40.276502 25864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:40.276516 25862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:40.276774 25854 server_base.cc:1034] running on GCE node
I20260809 23:23:40.277021 25854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:40.277292 25854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:40.278467 25854 hybrid_clock.cc:648] HybridClock initialized: now 1786317820278453 us; error 23 us; skew 500 ppm
Aug 09 23:23:40 dist-test-slave-6nmv krb5kdc[25840](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317820, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:40.280864 25854 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 23:23:40.281281 25854 webserver.cc:460] Webserver started at http://127.0.0.1:46471/ using document root <none> and password file <none>
I20260809 23:23:40.281502 25854 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:40.281581 25854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:40.281750 25854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:40.282693 25854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "27fe85a329b0412cb23afdd5155f3b4d"
format_stamp: "Formatted at 2026-08-09 23:23:40 on dist-test-slave-6nmv"
server_key: "f71a936055a2a951bf7c91a03bee1bc8"
server_key_iv: "039427e20612ef06c6a417966861efb7"
server_key_version: "encryptionkey@0"
I20260809 23:23:40.283146 25854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "27fe85a329b0412cb23afdd5155f3b4d"
format_stamp: "Formatted at 2026-08-09 23:23:40 on dist-test-slave-6nmv"
server_key: "f71a936055a2a951bf7c91a03bee1bc8"
server_key_iv: "039427e20612ef06c6a417966861efb7"
server_key_version: "encryptionkey@0"
I20260809 23:23:40.284368 25854 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:23:40.285054 25871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:40.285219 25854 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:40.285326 25854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "27fe85a329b0412cb23afdd5155f3b4d"
format_stamp: "Formatted at 2026-08-09 23:23:40 on dist-test-slave-6nmv"
server_key: "f71a936055a2a951bf7c91a03bee1bc8"
server_key_iv: "039427e20612ef06c6a417966861efb7"
server_key_version: "encryptionkey@0"
I20260809 23:23:40.285409 25854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:40.288450 25854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:40.290702 25854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:40.290848 25854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:40.294720 25854 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35005
I20260809 23:23:40.294747 25927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35005 every 8 connection(s)
I20260809 23:23:40.295086 25854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:40.296046 25928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:40.297910 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 25854
I20260809 23:23:40.298034 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:40.298137 25928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d: Bootstrap starting.
I20260809 23:23:40.298223 1966 external_mini_cluster.cc:1428] Setting key dd30b94a7f88837b9556bb8a11c431e2
I20260809 23:23:40.298867 25928 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:40.299253 25928 log.cc:824] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:40.299952 25928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d: No bootstrap required, opened a new log
I20260809 23:23:40.300940 25932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:40.298738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:43029 (local address 127.0.0.1:35005)
0809 23:23:40.299139 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:40.299147 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:40.299176 (+ 29us) server_negotiation.cc:407] Connection header received
0809 23:23:40.299667 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:40.299675 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:40.299712 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:40.299848 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:40.300405 (+ 557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:40.300409 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:40.300409 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:40.300413 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:40.300461 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:40.300474 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:40.300566 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:40.300609 (+ 43us) server_negotiation.cc:299] Negotiation successful
0809 23:23:40.300762 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":86,"threads_started":1}
I20260809 23:23:40.301857 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:40.302209 25928 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27fe85a329b0412cb23afdd5155f3b4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35005 } }
I20260809 23:23:40.302322 25928 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:40.302342 25928 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27fe85a329b0412cb23afdd5155f3b4d, State: Initialized, Role: FOLLOWER
I20260809 23:23:40.302503 25928 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27fe85a329b0412cb23afdd5155f3b4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35005 } }
I20260809 23:23:40.302603 25928 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:40.302647 25928 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:40.302702 25928 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:40.303372 25928 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27fe85a329b0412cb23afdd5155f3b4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35005 } }
I20260809 23:23:40.303478 25928 leader_election.cc:302] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27fe85a329b0412cb23afdd5155f3b4d; no voters:
I20260809 23:23:40.303617 25928 leader_election.cc:288] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:40.303638 25939 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:40.303740 25939 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [term 1 LEADER]: Becoming Leader. State: Replica: 27fe85a329b0412cb23afdd5155f3b4d, State: Running, Role: LEADER
I20260809 23:23:40.303834 25928 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:40.303860 25939 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27fe85a329b0412cb23afdd5155f3b4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35005 } }
I20260809 23:23:40.304163 25932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:40.303203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.217:41805 (local address 127.0.0.1:35005)
0809 23:23:40.303244 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:40.303245 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:40.303325 (+ 80us) server_negotiation.cc:407] Connection header received
0809 23:23:40.303394 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:40.303395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:40.303399 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:40.303449 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:40.303960 (+ 511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:40.303961 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:40.303961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:40.303965 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:40.303975 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:40.303978 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:40.304015 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:40.304094 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 23:23:40.304105 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 23:23:40.304841 25940 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27fe85a329b0412cb23afdd5155f3b4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27fe85a329b0412cb23afdd5155f3b4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35005 } } }
I20260809 23:23:40.304992 25940 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:40.305172 25941 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27fe85a329b0412cb23afdd5155f3b4d. Latest consensus state: current_term: 1 leader_uuid: "27fe85a329b0412cb23afdd5155f3b4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27fe85a329b0412cb23afdd5155f3b4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35005 } } }
I20260809 23:23:40.305209 25953 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:40.305287 25941 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:40.305765 25953 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:40.307137 25953 catalog_manager.cc:1347] Generated new cluster ID: 38d17f6224d6405c86c6605e796f79b3
I20260809 23:23:40.307188 25953 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:40.322470 25953 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:40.322626 25953 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:40.324687 25953 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27fe85a329b0412cb23afdd5155f3b4d: Generated new TSK 0
I20260809 23:23:40.324867 25953 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:40.332053 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 25854
2026-08-09T23:23:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1281 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:40 dist-test-slave-6nmv krb5kdc[25963](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:40 dist-test-slave-6nmv krb5kdc[25963](info): set up 2 sockets
Aug 09 23:23:40 dist-test-slave-6nmv krb5kdc[25963](info): commencing operation
krb5kdc: starting...
W20260809 23:23:41.344897 1966 mini_kdc.cc:121] Time spent starting KDC: real 0.993s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:41 dist-test-slave-6nmv krb5kdc[25963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:23:41.488129 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:34377
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:44561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:34377
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:41.562269 25978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:41.562489 25978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:41.562522 25978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:41.563555 25978 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:41.563616 25978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:41.563638 25978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:41.563657 25978 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:41.563681 25978 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:41.564931 25978 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:44561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:34377
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:34377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:41.565227 25978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:41.565460 25978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:41.569816 25986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:41.569904 25987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:41.569904 25989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:41.570238 25978 server_base.cc:1034] running on GCE node
I20260809 23:23:41.570473 25978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:41.570719 25978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:41.571887 25978 hybrid_clock.cc:648] HybridClock initialized: now 1786317821571875 us; error 21 us; skew 500 ppm
Aug 09 23:23:41 dist-test-slave-6nmv krb5kdc[25963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317821, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:41.574484 25978 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:23:41.574918 25978 webserver.cc:460] Webserver started at http://127.1.235.190:38417/ using document root <none> and password file <none>
I20260809 23:23:41.575160 25978 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:41.575233 25978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:41.575398 25978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:41.576411 25978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "b49e2abe218148b2b9a4cee9f98e3b8f"
format_stamp: "Formatted at 2026-08-09 23:23:41 on dist-test-slave-6nmv"
server_key: "7586614aebe06829655706a337c006c8"
server_key_iv: "e803550e44ac3c2e22d57b575b25308d"
server_key_version: "encryptionkey@0"
I20260809 23:23:41.576783 25978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "b49e2abe218148b2b9a4cee9f98e3b8f"
format_stamp: "Formatted at 2026-08-09 23:23:41 on dist-test-slave-6nmv"
server_key: "7586614aebe06829655706a337c006c8"
server_key_iv: "e803550e44ac3c2e22d57b575b25308d"
server_key_version: "encryptionkey@0"
I20260809 23:23:41.578131 25978 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 23:23:41.578809 25996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:41.578963 25978 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:41.579052 25978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "b49e2abe218148b2b9a4cee9f98e3b8f"
format_stamp: "Formatted at 2026-08-09 23:23:41 on dist-test-slave-6nmv"
server_key: "7586614aebe06829655706a337c006c8"
server_key_iv: "e803550e44ac3c2e22d57b575b25308d"
server_key_version: "encryptionkey@0"
I20260809 23:23:41.579123 25978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:41.589030 25978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:41.591254 25978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:41.591423 25978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:41.595235 25978 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:34377
I20260809 23:23:41.595288 26053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:34377 every 8 connection(s)
I20260809 23:23:41.595630 25978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:41.596441 26054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:41.598570 26054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f: Bootstrap starting.
I20260809 23:23:41.599047 26054 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:41.599291 26054 log.cc:824] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:41.599921 26054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f: No bootstrap required, opened a new log
I20260809 23:23:41.601425 26054 raft_consensus.cc:348] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b49e2abe218148b2b9a4cee9f98e3b8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34377 } }
I20260809 23:23:41.601559 26054 raft_consensus.cc:374] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:41.601600 26054 raft_consensus.cc:729] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b49e2abe218148b2b9a4cee9f98e3b8f, State: Initialized, Role: FOLLOWER
I20260809 23:23:41.601763 26054 consensus_queue.cc:260] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b49e2abe218148b2b9a4cee9f98e3b8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34377 } }
I20260809 23:23:41.601869 26054 raft_consensus.cc:388] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:41.601920 26054 raft_consensus.cc:482] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:41.601969 26054 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:41.602677 26054 raft_consensus.cc:504] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b49e2abe218148b2b9a4cee9f98e3b8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34377 } }
I20260809 23:23:41.602785 26054 leader_election.cc:302] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b49e2abe218148b2b9a4cee9f98e3b8f; no voters:
I20260809 23:23:41.602962 26054 leader_election.cc:288] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:41.602996 26057 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:41.603091 26057 raft_consensus.cc:686] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [term 1 LEADER]: Becoming Leader. State: Replica: b49e2abe218148b2b9a4cee9f98e3b8f, State: Running, Role: LEADER
I20260809 23:23:41.603088 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 25978
I20260809 23:23:41.603193 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:41.603197 26054 sys_catalog.cc:564] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:41.603222 26057 consensus_queue.cc:237] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b49e2abe218148b2b9a4cee9f98e3b8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34377 } }
I20260809 23:23:41.603384 1966 external_mini_cluster.cc:1428] Setting key 5fac4b60c1ca42034f7d2c891dea2ce2
I20260809 23:23:41.603525 26059 sys_catalog.cc:455] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b49e2abe218148b2b9a4cee9f98e3b8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b49e2abe218148b2b9a4cee9f98e3b8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34377 } } }
I20260809 23:23:41.603641 26059 sys_catalog.cc:458] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:41.603838 26058 sys_catalog.cc:455] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b49e2abe218148b2b9a4cee9f98e3b8f. Latest consensus state: current_term: 1 leader_uuid: "b49e2abe218148b2b9a4cee9f98e3b8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b49e2abe218148b2b9a4cee9f98e3b8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 34377 } } }
I20260809 23:23:41.603931 26058 sys_catalog.cc:458] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:41.604081 26065 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:41.604629 26065 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:41.606283 26065 catalog_manager.cc:1347] Generated new cluster ID: 200b9c56dca642688c088a1a9fb8c939
I20260809 23:23:41.606335 26065 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 09 23:23:41 dist-test-slave-6nmv krb5kdc[25963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:41.614857 26071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:41.604123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43633 (local address 127.1.235.190:34377)
0809 23:23:41.604538 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:41.604547 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:41.604580 (+ 33us) server_negotiation.cc:407] Connection header received
0809 23:23:41.604687 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:41.604694 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:41.604749 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:41.605090 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:41.605730 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:41.607004 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:41.607980 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:41.608536 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:41.608629 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:41.611234 (+ 2605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:41.611238 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:41.611238 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:41.611248 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:41.613130 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:41.613536 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:41.613540 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:41.613540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:41.613649 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:41.613904 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:41.613905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:41.613905 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:41.614181 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:41.614336 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:41.614456 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 23:23:41.614667 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":366,"thread_start_us":169,"threads_started":1}
I20260809 23:23:41.615417 26065 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:41.615689 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:41.615948 26065 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:41.618353 26065 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b49e2abe218148b2b9a4cee9f98e3b8f: Generated new TSK 0
I20260809 23:23:41.618495 26065 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:41.623289 26071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:41.616964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38653 (local address 127.1.235.190:34377)
0809 23:23:41.616992 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:41.616994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:41.617226 (+ 232us) server_negotiation.cc:407] Connection header received
0809 23:23:41.617303 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:41.617304 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:41.617311 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:41.617334 (+ 23us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:41.617957 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:41.618641 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:41.619559 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:41.619743 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:41.619798 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:41.620942 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:41.620943 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:41.620943 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:41.620949 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:41.622250 (+ 1301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:41.622624 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:41.622625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:41.622625 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:41.622676 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:41.622909 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:41.622909 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:41.622910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:41.622994 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:41.623064 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:41.623201 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 23:23:41.623245 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260809 23:23:41.624898 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 25978
W20260809 23:23:41.633114 25961 connection.cc:535] client connection to 127.1.235.190:34377 recv error: Network error: failed to read from TLS socket (remote: 127.1.235.190:34377): Connection reset by peer (error 104)
2026-08-09T23:23:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1294 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:41 dist-test-slave-6nmv krb5kdc[26090](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:41 dist-test-slave-6nmv krb5kdc[26090](info): set up 2 sockets
Aug 09 23:23:41 dist-test-slave-6nmv krb5kdc[26090](info): commencing operation
krb5kdc: starting...
W20260809 23:23:42.685830 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.039s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:42 dist-test-slave-6nmv krb5kdc[26090](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:23:42.792959 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:40557
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:43655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:40557
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:42.866726 26106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:42.866884 26106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:42.866904 26106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:42.867911 26106 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:42.867950 26106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:42.867965 26106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:42.868000 26106 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:42.868026 26106 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:42.869381 26106 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:43655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:40557
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:40557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26106
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:42.869593 26106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:42.869777 26106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:42.874065 26111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:42.874065 26112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:42.874115 26114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:42.874225 26106 server_base.cc:1034] running on GCE node
I20260809 23:23:42.874538 26106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:42.874830 26106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:42.875995 26106 hybrid_clock.cc:648] HybridClock initialized: now 1786317822875993 us; error 34 us; skew 500 ppm
Aug 09 23:23:42 dist-test-slave-6nmv krb5kdc[26090](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317822, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:42.878373 26106 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:23:42.878871 26106 webserver.cc:460] Webserver started at http://127.1.235.190:39435/ using document root <none> and password file <none>
I20260809 23:23:42.879118 26106 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:42.879189 26106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:42.879328 26106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:42.880287 26106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "29f73643010b43e4ac9de03cccc58a46"
format_stamp: "Formatted at 2026-08-09 23:23:42 on dist-test-slave-6nmv"
server_key: "d5a111fcd45cc5085f8033313c546b22"
server_key_iv: "fb3acbd8c39ac208349d52cb5ebbeba8"
server_key_version: "encryptionkey@0"
I20260809 23:23:42.880637 26106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "29f73643010b43e4ac9de03cccc58a46"
format_stamp: "Formatted at 2026-08-09 23:23:42 on dist-test-slave-6nmv"
server_key: "d5a111fcd45cc5085f8033313c546b22"
server_key_iv: "fb3acbd8c39ac208349d52cb5ebbeba8"
server_key_version: "encryptionkey@0"
I20260809 23:23:42.881939 26106 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:23:42.882649 26122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:42.882813 26106 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:42.882910 26106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "29f73643010b43e4ac9de03cccc58a46"
format_stamp: "Formatted at 2026-08-09 23:23:42 on dist-test-slave-6nmv"
server_key: "d5a111fcd45cc5085f8033313c546b22"
server_key_iv: "fb3acbd8c39ac208349d52cb5ebbeba8"
server_key_version: "encryptionkey@0"
I20260809 23:23:42.882993 26106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:42.893311 26106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:42.895730 26106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:42.895895 26106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:42.900178 26106 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:40557
I20260809 23:23:42.900206 26185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:40557 every 8 connection(s)
I20260809 23:23:42.900525 26106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:42.901265 26186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:42.903293 26186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46: Bootstrap starting.
I20260809 23:23:42.903893 26186 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:42.904186 26186 log.cc:824] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:42.904819 26186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46: No bootstrap required, opened a new log
I20260809 23:23:42.906441 26186 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29f73643010b43e4ac9de03cccc58a46" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40557 } }
I20260809 23:23:42.906595 26186 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:42.906634 26186 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29f73643010b43e4ac9de03cccc58a46, State: Initialized, Role: FOLLOWER
I20260809 23:23:42.906667 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 26106
I20260809 23:23:42.906771 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:42.906801 26186 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29f73643010b43e4ac9de03cccc58a46" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40557 } }
I20260809 23:23:42.906878 26186 raft_consensus.cc:388] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:42.906916 26186 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:42.906946 1966 external_mini_cluster.cc:1428] Setting key ff8b3bd6fe76ef2275aa191b167e4108
I20260809 23:23:42.906962 26186 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:42.907923 26186 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29f73643010b43e4ac9de03cccc58a46" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40557 } }
I20260809 23:23:42.908030 26186 leader_election.cc:302] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29f73643010b43e4ac9de03cccc58a46; no voters:
I20260809 23:23:42.908186 26186 leader_election.cc:288] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:42.908222 26191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:42.908401 26191 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [term 1 LEADER]: Becoming Leader. State: Replica: 29f73643010b43e4ac9de03cccc58a46, State: Running, Role: LEADER
I20260809 23:23:42.908453 26186 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:42.908560 26191 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29f73643010b43e4ac9de03cccc58a46" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40557 } }
I20260809 23:23:42.910410 26195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29f73643010b43e4ac9de03cccc58a46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29f73643010b43e4ac9de03cccc58a46" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40557 } } }
I20260809 23:23:42.910466 26195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:42.910271 26192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29f73643010b43e4ac9de03cccc58a46. Latest consensus state: current_term: 1 leader_uuid: "29f73643010b43e4ac9de03cccc58a46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29f73643010b43e4ac9de03cccc58a46" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40557 } } }
W20260809 23:23:42.910629 26208 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260809 23:23:42.910669 26192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46 [sys.catalog]: This master's current role is: LEADER
W20260809 23:23:42.910670 26208 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:23:42.911098 26210 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:42.911288 26210 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:42.912513 26190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:42.907377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43015 (local address 127.1.235.190:40557)
0809 23:23:42.907582 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:42.907597 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:42.907627 (+ 30us) server_negotiation.cc:407] Connection header received
0809 23:23:42.907708 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:42.907713 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:42.907748 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:42.907876 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:42.908088 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:42.909375 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:42.910399 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:42.910937 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:42.911029 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:42.911815 (+ 786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:42.911819 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:42.911819 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:42.912018 (+ 199us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:42.912055 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:42.912071 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:42.912166 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:42.912272 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 23:23:42.912300 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":132,"threads_started":1}
I20260809 23:23:42.913552 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:42.913586 26210 catalog_manager.cc:1347] Generated new cluster ID: d934bac504474d028eaf5a88184bb40d
I20260809 23:23:42.913620 26210 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:42.918273 26190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:42.914978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40105 (local address 127.1.235.190:40557)
0809 23:23:42.915015 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:42.915016 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:42.915025 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:23:42.915119 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:42.915120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:42.915130 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:42.915200 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:42.915316 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:42.916051 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:42.916981 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:42.917285 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:42.917353 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:42.918031 (+ 678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:42.918033 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:42.918033 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:42.918037 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:42.918050 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:42.918054 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:42.918112 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:42.918190 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 23:23:42.918201 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260809 23:23:42.936477 26210 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:42.936996 26210 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:42.939075 26210 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 29f73643010b43e4ac9de03cccc58a46: Generated new TSK 0
I20260809 23:23:42.939239 26210 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:42.950045 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 26106
W20260809 23:23:42.957016 26088 connection.cc:535] client connection to 127.1.235.190:40557 recv error: Network error: failed to read from TLS socket (remote: 127.1.235.190:40557): Connection reset by peer (error 104)
2026-08-09T23:23:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1323 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:43 dist-test-slave-6nmv krb5kdc[26222](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:43 dist-test-slave-6nmv krb5kdc[26222](info): set up 2 sockets
Aug 09 23:23:43 dist-test-slave-6nmv krb5kdc[26222](info): commencing operation
krb5kdc: starting...
W20260809 23:23:43.961012 1966 mini_kdc.cc:121] Time spent starting KDC: real 0.991s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:44 dist-test-slave-6nmv krb5kdc[26222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:23:44.069628 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:46019
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:36869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:46019
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:44.142199 26236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:44.142403 26236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:44.142441 26236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:44.143471 26236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:44.143532 26236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:44.143555 26236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:44.143575 26236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:44.143599 26236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:44.144963 26236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:36869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:46019
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:46019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:44.145242 26236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:44.145478 26236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:44.150153 26247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:44.150175 26236 server_base.cc:1034] running on GCE node
W20260809 23:23:44.150146 26244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:44.150146 26243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:44.150593 26236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:44.150823 26236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:44.151958 26236 hybrid_clock.cc:648] HybridClock initialized: now 1786317824151949 us; error 25 us; skew 500 ppm
Aug 09 23:23:44 dist-test-slave-6nmv krb5kdc[26222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317824, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:44.157548 26236 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:23:44.158042 26236 webserver.cc:460] Webserver started at http://127.1.235.190:32831/ using document root <none> and password file <none>
I20260809 23:23:44.158278 26236 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:44.158347 26236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:44.158506 26236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:44.159498 26236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "47625d9f78ef458b8511a7649a080313"
format_stamp: "Formatted at 2026-08-09 23:23:44 on dist-test-slave-6nmv"
server_key: "59ea0edf2433ee7100f911bfcd7bb553"
server_key_iv: "b621d3a589da3109b4f87e15d26b01e2"
server_key_version: "encryptionkey@0"
I20260809 23:23:44.159842 26236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "47625d9f78ef458b8511a7649a080313"
format_stamp: "Formatted at 2026-08-09 23:23:44 on dist-test-slave-6nmv"
server_key: "59ea0edf2433ee7100f911bfcd7bb553"
server_key_iv: "b621d3a589da3109b4f87e15d26b01e2"
server_key_version: "encryptionkey@0"
I20260809 23:23:44.161109 26236 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:23:44.161836 26254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:44.161996 26236 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:44.162097 26236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "47625d9f78ef458b8511a7649a080313"
format_stamp: "Formatted at 2026-08-09 23:23:44 on dist-test-slave-6nmv"
server_key: "59ea0edf2433ee7100f911bfcd7bb553"
server_key_iv: "b621d3a589da3109b4f87e15d26b01e2"
server_key_version: "encryptionkey@0"
I20260809 23:23:44.162204 26236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:44.165253 26236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:44.167073 26236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:44.167218 26236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:44.171140 26236 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:46019
I20260809 23:23:44.171170 26315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:46019 every 8 connection(s)
I20260809 23:23:44.171458 26236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:44.172354 26317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:44.173483 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 26236
I20260809 23:23:44.173610 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:44.173784 1966 external_mini_cluster.cc:1428] Setting key 73c024f50e19c45b2ad33b95e7519f79
I20260809 23:23:44.174571 26317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313: Bootstrap starting.
I20260809 23:23:44.175051 26317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:44.175419 26317 log.cc:824] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:44.176096 26320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:44.174267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54921 (local address 127.1.235.190:46019)
0809 23:23:44.174441 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:44.174449 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:44.174481 (+ 32us) server_negotiation.cc:407] Connection header received
0809 23:23:44.174868 (+ 387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:44.174874 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:44.174897 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:44.175044 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:44.175686 (+ 642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:44.175689 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:44.175690 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:44.175694 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:44.175738 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:44.175748 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:44.175838 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:44.175905 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 23:23:44.175945 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":81,"threads_started":1}
I20260809 23:23:44.176209 26317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313: No bootstrap required, opened a new log
I20260809 23:23:44.176959 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:44.178211 26317 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47625d9f78ef458b8511a7649a080313" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 46019 } }
I20260809 23:23:44.178365 26317 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:44.178409 26317 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47625d9f78ef458b8511a7649a080313, State: Initialized, Role: FOLLOWER
I20260809 23:23:44.178516 26317 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47625d9f78ef458b8511a7649a080313" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 46019 } }
I20260809 23:23:44.178604 26317 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:44.178639 26317 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:44.178683 26317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:44.179283 26320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:44.178315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50321 (local address 127.1.235.190:46019)
0809 23:23:44.178365 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:44.178366 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:44.178479 (+ 113us) server_negotiation.cc:407] Connection header received
0809 23:23:44.178537 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:44.178538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:44.178542 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:44.178594 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:44.179086 (+ 492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:44.179087 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:44.179087 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:44.179091 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:44.179103 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:44.179107 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:44.179168 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:44.179198 (+ 30us) server_negotiation.cc:299] Negotiation successful
0809 23:23:44.179209 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 23:23:44.179353 26317 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47625d9f78ef458b8511a7649a080313" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 46019 } }
I20260809 23:23:44.179430 26317 leader_election.cc:302] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47625d9f78ef458b8511a7649a080313; no voters:
I20260809 23:23:44.179621 26317 leader_election.cc:288] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:44.179682 26328 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:44.179839 26317 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:44.179899 26328 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [term 1 LEADER]: Becoming Leader. State: Replica: 47625d9f78ef458b8511a7649a080313, State: Running, Role: LEADER
I20260809 23:23:44.180045 26328 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47625d9f78ef458b8511a7649a080313" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 46019 } }
I20260809 23:23:44.180477 26329 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47625d9f78ef458b8511a7649a080313" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47625d9f78ef458b8511a7649a080313" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 46019 } } }
I20260809 23:23:44.180490 26330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47625d9f78ef458b8511a7649a080313. Latest consensus state: current_term: 1 leader_uuid: "47625d9f78ef458b8511a7649a080313" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47625d9f78ef458b8511a7649a080313" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 46019 } } }
I20260809 23:23:44.180580 26329 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:44.180588 26330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:44.180757 26338 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:44.181176 26338 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:44.182577 26338 catalog_manager.cc:1347] Generated new cluster ID: 0f71edb25cc44ac89fd94563410e0860
I20260809 23:23:44.182626 26338 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:44.188418 26338 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:44.188561 26338 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:44.193073 26338 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47625d9f78ef458b8511a7649a080313: Generated new TSK 0
I20260809 23:23:44.193208 26338 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:44.195061 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 26236
2026-08-09T23:23:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1248 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:44 dist-test-slave-6nmv krb5kdc[26352](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:44 dist-test-slave-6nmv krb5kdc[26352](info): set up 2 sockets
Aug 09 23:23:44 dist-test-slave-6nmv krb5kdc[26352](info): commencing operation
krb5kdc: starting...
W20260809 23:23:45.208933 1966 mini_kdc.cc:121] Time spent starting KDC: real 0.990s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:45 dist-test-slave-6nmv krb5kdc[26352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:23:45.332495 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:43457
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:38887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:43457
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:45.412120 26366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:45.412372 26366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:45.412412 26366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:45.413599 26366 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:45.413681 26366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:45.413710 26366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:45.413744 26366 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:45.413770 26366 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:45.415138 26366 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:38887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:43457
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:43457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:45.415412 26366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:45.415634 26366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:45.420171 26371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:45.420177 26374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:45.420184 26372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:45.420502 26366 server_base.cc:1034] running on GCE node
I20260809 23:23:45.420760 26366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:45.421051 26366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:45.422186 26366 hybrid_clock.cc:648] HybridClock initialized: now 1786317825422171 us; error 29 us; skew 500 ppm
Aug 09 23:23:45 dist-test-slave-6nmv krb5kdc[26352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317825, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:45.424386 26366 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:23:45.424816 26366 webserver.cc:460] Webserver started at http://127.1.235.190:46581/ using document root <none> and password file <none>
I20260809 23:23:45.425035 26366 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:45.425101 26366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:45.425249 26366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:45.426411 26366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "25b13bca7bfc49879466a6cdf31df324"
format_stamp: "Formatted at 2026-08-09 23:23:45 on dist-test-slave-6nmv"
server_key: "f3ed7fad3a9c4ac8334b59c7d7c1ab37"
server_key_iv: "6c56b00ee0f379ac14ca71281d838f61"
server_key_version: "encryptionkey@0"
I20260809 23:23:45.426800 26366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "25b13bca7bfc49879466a6cdf31df324"
format_stamp: "Formatted at 2026-08-09 23:23:45 on dist-test-slave-6nmv"
server_key: "f3ed7fad3a9c4ac8334b59c7d7c1ab37"
server_key_iv: "6c56b00ee0f379ac14ca71281d838f61"
server_key_version: "encryptionkey@0"
I20260809 23:23:45.428169 26366 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:23:45.428903 26381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:45.429070 26366 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:45.429173 26366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "25b13bca7bfc49879466a6cdf31df324"
format_stamp: "Formatted at 2026-08-09 23:23:45 on dist-test-slave-6nmv"
server_key: "f3ed7fad3a9c4ac8334b59c7d7c1ab37"
server_key_iv: "6c56b00ee0f379ac14ca71281d838f61"
server_key_version: "encryptionkey@0"
I20260809 23:23:45.429262 26366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:45.448067 26366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:45.449937 26366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:45.450094 26366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:45.454326 26366 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:43457
I20260809 23:23:45.454357 26439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:43457 every 8 connection(s)
I20260809 23:23:45.454684 26366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:45.455493 26440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:45.456609 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 26366
I20260809 23:23:45.456730 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:45.456928 1966 external_mini_cluster.cc:1428] Setting key d9c7558710b660e2196173edfdeb811d
I20260809 23:23:45.458155 26440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324: Bootstrap starting.
I20260809 23:23:45.458920 26440 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:45.459345 26440 log.cc:824] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:45.460145 26440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324: No bootstrap required, opened a new log
I20260809 23:23:45.461985 26440 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b13bca7bfc49879466a6cdf31df324" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43457 } }
I20260809 23:23:45.462126 26440 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:45.462172 26440 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b13bca7bfc49879466a6cdf31df324, State: Initialized, Role: FOLLOWER
I20260809 23:23:45.462285 26440 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b13bca7bfc49879466a6cdf31df324" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43457 } }
I20260809 23:23:45.462363 26440 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:45.462404 26440 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:45.462456 26440 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:45.463078 26440 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b13bca7bfc49879466a6cdf31df324" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43457 } }
I20260809 23:23:45.463207 26440 leader_election.cc:302] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25b13bca7bfc49879466a6cdf31df324; no voters:
I20260809 23:23:45.463356 26440 leader_election.cc:288] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [CANDIDATE]: Term 1 election: Requested vote from peers
Aug 09 23:23:45 dist-test-slave-6nmv krb5kdc[26352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:45.463382 26445 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:45.463549 26445 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [term 1 LEADER]: Becoming Leader. State: Replica: 25b13bca7bfc49879466a6cdf31df324, State: Running, Role: LEADER
I20260809 23:23:45.463606 26440 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:45.463678 26445 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b13bca7bfc49879466a6cdf31df324" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43457 } }
I20260809 23:23:45.464041 26446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25b13bca7bfc49879466a6cdf31df324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b13bca7bfc49879466a6cdf31df324" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43457 } } }
I20260809 23:23:45.464138 26446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:45.464022 26445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25b13bca7bfc49879466a6cdf31df324. Latest consensus state: current_term: 1 leader_uuid: "25b13bca7bfc49879466a6cdf31df324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25b13bca7bfc49879466a6cdf31df324" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43457 } } }
I20260809 23:23:45.464268 26445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:45.464476 26450 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:45.465593 26450 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:45.467882 26443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:45.457426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54967 (local address 127.1.235.190:43457)
0809 23:23:45.457591 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:45.457598 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:45.457620 (+ 22us) server_negotiation.cc:407] Connection header received
0809 23:23:45.458054 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:45.458060 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:45.458102 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:45.458206 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:45.459002 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:45.459958 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:45.460748 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:45.461170 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:45.461297 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:45.464074 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:45.464077 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:45.464078 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:45.464088 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:45.466317 (+ 2229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:45.466786 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:45.466789 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:45.466789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:45.466893 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:45.467084 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:45.467084 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:45.467085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:45.467350 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:45.467486 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:45.467570 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 23:23:45.467693 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
I20260809 23:23:45.468828 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:45.471629 26450 catalog_manager.cc:1347] Generated new cluster ID: 91c561607ee64becb2ace3fe7eb147b6
I20260809 23:23:45.471683 26450 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:45.476339 26443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:45.470228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43951 (local address 127.1.235.190:43457)
0809 23:23:45.470272 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:45.470274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:45.470552 (+ 278us) server_negotiation.cc:407] Connection header received
0809 23:23:45.470572 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:45.470573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:45.470582 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:45.470642 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:45.471239 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:45.471669 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:45.472368 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:45.472601 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:45.472677 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:45.473776 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:45.473777 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:45.473777 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:45.473783 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:45.475164 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:45.475547 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:45.475548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:45.475548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:45.475607 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:45.475817 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:45.475818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:45.475818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:45.475925 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:45.476022 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:45.476136 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 23:23:45.476212 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260809 23:23:45.503814 26450 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:45.504262 26450 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:45.508356 26450 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25b13bca7bfc49879466a6cdf31df324: Generated new TSK 0
I20260809 23:23:45.508544 26450 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:45.515040 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 26366
2026-08-09T23:23:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1317 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:45 dist-test-slave-6nmv krb5kdc[26474](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:45 dist-test-slave-6nmv krb5kdc[26474](info): set up 2 sockets
Aug 09 23:23:45 dist-test-slave-6nmv krb5kdc[26474](info): commencing operation
krb5kdc: starting...
W20260809 23:23:46.528815 1966 mini_kdc.cc:121] Time spent starting KDC: real 0.992s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:46 dist-test-slave-6nmv krb5kdc[26474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:23:46.641911 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:43181
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:42599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:43181
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:46.717602 26489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:46.717804 26489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:46.717851 26489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:46.718881 26489 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:46.718945 26489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:46.718966 26489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:46.719014 26489 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:46.719043 26489 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:46.720341 26489 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:42599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:43181
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:43181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:46.720594 26489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:46.720824 26489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:46.725256 26500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:46.725311 26489 server_base.cc:1034] running on GCE node
W20260809 23:23:46.725244 26497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:46.725256 26498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:46.725678 26489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:46.726050 26489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:46.727219 26489 hybrid_clock.cc:648] HybridClock initialized: now 1786317826727200 us; error 34 us; skew 500 ppm
Aug 09 23:23:46 dist-test-slave-6nmv krb5kdc[26474](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317826, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:46.729465 26489 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:23:46.729949 26489 webserver.cc:460] Webserver started at http://127.1.235.190:39461/ using document root <none> and password file <none>
I20260809 23:23:46.730155 26489 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:46.730214 26489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:46.730338 26489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:46.731240 26489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "af0b0eb1f0fd4ff7b6ca87a5e25f3c8f"
format_stamp: "Formatted at 2026-08-09 23:23:46 on dist-test-slave-6nmv"
server_key: "430685353ad259c817e5b06904687762"
server_key_iv: "eeef6cd0fa376ff6ead977e38c66fb11"
server_key_version: "encryptionkey@0"
I20260809 23:23:46.731567 26489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "af0b0eb1f0fd4ff7b6ca87a5e25f3c8f"
format_stamp: "Formatted at 2026-08-09 23:23:46 on dist-test-slave-6nmv"
server_key: "430685353ad259c817e5b06904687762"
server_key_iv: "eeef6cd0fa376ff6ead977e38c66fb11"
server_key_version: "encryptionkey@0"
I20260809 23:23:46.732765 26489 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260809 23:23:46.733410 26507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:46.733569 26489 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:46.733652 26489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "af0b0eb1f0fd4ff7b6ca87a5e25f3c8f"
format_stamp: "Formatted at 2026-08-09 23:23:46 on dist-test-slave-6nmv"
server_key: "430685353ad259c817e5b06904687762"
server_key_iv: "eeef6cd0fa376ff6ead977e38c66fb11"
server_key_version: "encryptionkey@0"
I20260809 23:23:46.733740 26489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:46.741546 26489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:46.743363 26489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:46.743528 26489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:46.747579 26489 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:43181
I20260809 23:23:46.747609 26562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:43181 every 8 connection(s)
I20260809 23:23:46.747918 26489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:46.748646 26563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:46.750680 26563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f: Bootstrap starting.
I20260809 23:23:46.751263 26563 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:46.751520 26563 log.cc:824] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:46.752229 26563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f: No bootstrap required, opened a new log
I20260809 23:23:46.753733 26563 raft_consensus.cc:348] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af0b0eb1f0fd4ff7b6ca87a5e25f3c8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43181 } }
I20260809 23:23:46.753921 26563 raft_consensus.cc:374] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:46.753952 26563 raft_consensus.cc:729] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af0b0eb1f0fd4ff7b6ca87a5e25f3c8f, State: Initialized, Role: FOLLOWER
I20260809 23:23:46.754112 26563 consensus_queue.cc:260] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af0b0eb1f0fd4ff7b6ca87a5e25f3c8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43181 } }
I20260809 23:23:46.754170 26563 raft_consensus.cc:388] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:46.754225 26563 raft_consensus.cc:482] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:46.754274 26563 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:46.755025 26563 raft_consensus.cc:504] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af0b0eb1f0fd4ff7b6ca87a5e25f3c8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43181 } }
I20260809 23:23:46.755127 26563 leader_election.cc:302] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af0b0eb1f0fd4ff7b6ca87a5e25f3c8f; no voters:
I20260809 23:23:46.755297 26563 leader_election.cc:288] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:46.755441 26566 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:46.755538 26563 sys_catalog.cc:564] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:46.755635 26566 raft_consensus.cc:686] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [term 1 LEADER]: Becoming Leader. State: Replica: af0b0eb1f0fd4ff7b6ca87a5e25f3c8f, State: Running, Role: LEADER
I20260809 23:23:46.755751 26566 consensus_queue.cc:237] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af0b0eb1f0fd4ff7b6ca87a5e25f3c8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43181 } }
I20260809 23:23:46.756028 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 26489
I20260809 23:23:46.756161 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:46.756146 26568 sys_catalog.cc:455] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [sys.catalog]: SysCatalogTable state changed. Reason: New leader af0b0eb1f0fd4ff7b6ca87a5e25f3c8f. Latest consensus state: current_term: 1 leader_uuid: "af0b0eb1f0fd4ff7b6ca87a5e25f3c8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af0b0eb1f0fd4ff7b6ca87a5e25f3c8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43181 } } }
I20260809 23:23:46.756222 26568 sys_catalog.cc:458] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:46.756369 1966 external_mini_cluster.cc:1428] Setting key 692caf1f10f873e23dcf9a432e425d48
I20260809 23:23:46.756435 26576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:46.757128 26567 sys_catalog.cc:455] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af0b0eb1f0fd4ff7b6ca87a5e25f3c8f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af0b0eb1f0fd4ff7b6ca87a5e25f3c8f" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 43181 } } }
I20260809 23:23:46.757192 26576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:46.757210 26567 sys_catalog.cc:458] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:46.761404 26586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:46.757073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40921 (local address 127.1.235.190:43181)
0809 23:23:46.757236 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:46.757245 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:46.757284 (+ 39us) server_negotiation.cc:407] Connection header received
0809 23:23:46.757418 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:46.757428 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:46.757488 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:46.757620 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:46.757867 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:46.758750 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:46.759736 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:46.760091 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:46.760165 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:46.760773 (+ 608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:46.760777 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:46.760777 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:46.760927 (+ 150us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:46.760954 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:46.760964 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:46.761024 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:46.761114 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 23:23:46.761155 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":75,"threads_started":1}
I20260809 23:23:46.762218 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:46.762262 26576 catalog_manager.cc:1347] Generated new cluster ID: c1db76cb0b3d456493b9d6508dd6734c
I20260809 23:23:46.762311 26576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:46.767191 26586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:46.763612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37249 (local address 127.1.235.190:43181)
0809 23:23:46.763785 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:46.763786 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:46.763793 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:23:46.763809 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:46.763809 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:46.763818 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:46.763860 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:46.764038 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:46.764938 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:46.765943 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:46.766225 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:46.766285 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:46.766908 (+ 623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:46.766909 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:46.766909 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:46.766913 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:46.766924 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:46.766927 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:46.766971 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:46.767034 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 23:23:46.767054 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155}
I20260809 23:23:46.768837 26576 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:46.769495 26576 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:46.778265 26576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af0b0eb1f0fd4ff7b6ca87a5e25f3c8f: Generated new TSK 0
I20260809 23:23:46.778439 26576 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:46.781319 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 26489
2026-08-09T23:23:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1265 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:46 dist-test-slave-6nmv krb5kdc[26598](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:46 dist-test-slave-6nmv krb5kdc[26598](info): set up 2 sockets
Aug 09 23:23:46 dist-test-slave-6nmv krb5kdc[26598](info): commencing operation
krb5kdc: starting...
W20260809 23:23:47.812680 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.010s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:47 dist-test-slave-6nmv krb5kdc[26598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317827, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:23:47.922746 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:40977
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:37915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:40977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:47.998616 26614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:47.998793 26614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:47.998813 26614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:47.999850 26614 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:47.999889 26614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:47.999909 26614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:47.999920 26614 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:47.999971 26614 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:48.001398 26614 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:37915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:40977
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:40977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:48.001631 26614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:48.001878 26614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:48.006453 26622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:48.006464 26619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:48.006791 26620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:48.007269 26614 server_base.cc:1034] running on GCE node
I20260809 23:23:48.007534 26614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:48.007804 26614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:48.008980 26614 hybrid_clock.cc:648] HybridClock initialized: now 1786317828008955 us; error 25 us; skew 500 ppm
Aug 09 23:23:48 dist-test-slave-6nmv krb5kdc[26598](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317828, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:48.011546 26614 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:23:48.012025 26614 webserver.cc:460] Webserver started at http://127.1.235.190:41333/ using document root <none> and password file <none>
I20260809 23:23:48.012266 26614 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:48.012339 26614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:48.012516 26614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:48.013505 26614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "9dafa0b5f9814fafae8d6954e577adc3"
format_stamp: "Formatted at 2026-08-09 23:23:48 on dist-test-slave-6nmv"
server_key: "e4435aafcd4b76dcef86af82ad3c34fb"
server_key_iv: "ed710e00ecca8fae7c789b1df268b5bd"
server_key_version: "encryptionkey@0"
I20260809 23:23:48.013909 26614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "9dafa0b5f9814fafae8d6954e577adc3"
format_stamp: "Formatted at 2026-08-09 23:23:48 on dist-test-slave-6nmv"
server_key: "e4435aafcd4b76dcef86af82ad3c34fb"
server_key_iv: "ed710e00ecca8fae7c789b1df268b5bd"
server_key_version: "encryptionkey@0"
I20260809 23:23:48.015184 26614 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260809 23:23:48.015919 26629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:48.016088 26614 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:23:48.016191 26614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "9dafa0b5f9814fafae8d6954e577adc3"
format_stamp: "Formatted at 2026-08-09 23:23:48 on dist-test-slave-6nmv"
server_key: "e4435aafcd4b76dcef86af82ad3c34fb"
server_key_iv: "ed710e00ecca8fae7c789b1df268b5bd"
server_key_version: "encryptionkey@0"
I20260809 23:23:48.016304 26614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:48.019366 26614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:48.021102 26614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:48.021214 26614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:48.025527 26614 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:40977
I20260809 23:23:48.025609 26690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:40977 every 8 connection(s)
I20260809 23:23:48.026001 26614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:48.026559 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 26614
I20260809 23:23:48.026691 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:48.026935 1966 external_mini_cluster.cc:1428] Setting key ce697085e7615cf6c5ac85a887161ed1
I20260809 23:23:48.027170 26691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:48.029448 26694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:48.027463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47249 (local address 127.1.235.190:40977)
0809 23:23:48.027701 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:48.027709 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:48.027741 (+ 32us) server_negotiation.cc:407] Connection header received
0809 23:23:48.028190 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:48.028196 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:48.028220 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:48.028379 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:48.029024 (+ 645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:48.029028 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:48.029028 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:48.029033 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:48.029080 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:48.029090 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:48.029172 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:48.029245 (+ 73us) server_negotiation.cc:299] Negotiation successful
0809 23:23:48.029284 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":103,"threads_started":1}
I20260809 23:23:48.030268 26691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3: Bootstrap starting.
I20260809 23:23:48.030555 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:48.030905 26691 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:48.031186 26691 log.cc:824] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:48.032074 26691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3: No bootstrap required, opened a new log
I20260809 23:23:48.033057 26694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:48.032063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54815 (local address 127.1.235.190:40977)
0809 23:23:48.032103 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:48.032105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:48.032208 (+ 103us) server_negotiation.cc:407] Connection header received
0809 23:23:48.032262 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:48.032263 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:48.032268 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:48.032322 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:48.032851 (+ 529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:48.032852 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:48.032853 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 23:23:48.032857 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:48.032869 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 23:23:48.032872 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:48.032936 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:48.032982 (+ 46us) server_negotiation.cc:299] Negotiation successful
0809 23:23:48.032995 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260809 23:23:48.034343 26691 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dafa0b5f9814fafae8d6954e577adc3" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40977 } }
I20260809 23:23:48.034488 26691 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 23:23:48.034512 26691 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dafa0b5f9814fafae8d6954e577adc3, State: Initialized, Role: FOLLOWER
I20260809 23:23:48.034663 26691 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dafa0b5f9814fafae8d6954e577adc3" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40977 } }
I20260809 23:23:48.034749 26691 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 23:23:48.034792 26691 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 23:23:48.034839 26691 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:48.035343 26691 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dafa0b5f9814fafae8d6954e577adc3" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40977 } }
I20260809 23:23:48.035452 26691 leader_election.cc:302] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9dafa0b5f9814fafae8d6954e577adc3; no voters:
I20260809 23:23:48.035650 26691 leader_election.cc:288] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 23:23:48.035682 26703 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:48.035840 26703 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [term 1 LEADER]: Becoming Leader. State: Replica: 9dafa0b5f9814fafae8d6954e577adc3, State: Running, Role: LEADER
I20260809 23:23:48.035910 26691 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:48.035938 26703 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dafa0b5f9814fafae8d6954e577adc3" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40977 } }
I20260809 23:23:48.036325 26705 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9dafa0b5f9814fafae8d6954e577adc3. Latest consensus state: current_term: 1 leader_uuid: "9dafa0b5f9814fafae8d6954e577adc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dafa0b5f9814fafae8d6954e577adc3" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40977 } } }
I20260809 23:23:48.036325 26704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9dafa0b5f9814fafae8d6954e577adc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dafa0b5f9814fafae8d6954e577adc3" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 40977 } } }
I20260809 23:23:48.036454 26705 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:48.036459 26704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:48.037055 26711 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:48.037469 26711 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:48.038956 26711 catalog_manager.cc:1347] Generated new cluster ID: e54c0b434c894fcea74017cc64a62e03
I20260809 23:23:48.039014 26711 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:48.050959 26711 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:48.051127 26711 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:48.057875 26711 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9dafa0b5f9814fafae8d6954e577adc3: Generated new TSK 0
I20260809 23:23:48.058037 26711 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:48.067229 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 26614
2026-08-09T23:23:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1285 ms)
[----------] 18 tests from AuthTokenIssuingTest (23104 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:48 dist-test-slave-6nmv krb5kdc[26725](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:48 dist-test-slave-6nmv krb5kdc[26725](info): set up 2 sockets
Aug 09 23:23:48 dist-test-slave-6nmv krb5kdc[26725](info): commencing operation
krb5kdc: starting...
W20260809 23:23:49.089709 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.002s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:49 dist-test-slave-6nmv krb5kdc[26725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:23:49.200994 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:33663
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:35809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:33663,127.1.235.189:37017,127.1.235.188:45311
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:49.273583 26740 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 23:23:49.273746 26740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:49.273761 26740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:49.273778 26740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:49.274798 26740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:49.274834 26740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:49.274847 26740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:49.274857 26740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:49.274868 26740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:49.276125 26740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:35809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:33663,127.1.235.189:37017,127.1.235.188:45311
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:33663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:49.276300 26740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:49.276460 26740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:49.280437 26749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:49.280439 26746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:49.280493 26747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:49.280560 26740 server_base.cc:1034] running on GCE node
I20260809 23:23:49.280833 26740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:49.281037 26740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:49.282164 26740 hybrid_clock.cc:648] HybridClock initialized: now 1786317829282152 us; error 26 us; skew 500 ppm
Aug 09 23:23:49 dist-test-slave-6nmv krb5kdc[26725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317829, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:49.288924 26740 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:23:49.289283 26740 webserver.cc:460] Webserver started at http://127.1.235.190:39285/ using document root <none> and password file <none>
I20260809 23:23:49.289485 26740 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:49.289523 26740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:49.289644 26740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:49.290573 26740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "95f760d1769742e3a8e1feeb035c8439"
format_stamp: "Formatted at 2026-08-09 23:23:49 on dist-test-slave-6nmv"
server_key: "f2413ea196cc80d5e2630dae81e29610"
server_key_iv: "5b8d914e4df746242e018af3a4e41257"
server_key_version: "encryptionkey@0"
I20260809 23:23:49.290874 26740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "95f760d1769742e3a8e1feeb035c8439"
format_stamp: "Formatted at 2026-08-09 23:23:49 on dist-test-slave-6nmv"
server_key: "f2413ea196cc80d5e2630dae81e29610"
server_key_iv: "5b8d914e4df746242e018af3a4e41257"
server_key_version: "encryptionkey@0"
I20260809 23:23:49.292117 26740 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260809 23:23:49.292770 26757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:49.292953 26740 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:49.293035 26740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "95f760d1769742e3a8e1feeb035c8439"
format_stamp: "Formatted at 2026-08-09 23:23:49 on dist-test-slave-6nmv"
server_key: "f2413ea196cc80d5e2630dae81e29610"
server_key_iv: "5b8d914e4df746242e018af3a4e41257"
server_key_version: "encryptionkey@0"
I20260809 23:23:49.293115 26740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:49.304118 26740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:49.305658 26740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:49.305892 26740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:49.309433 26740 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:33663
I20260809 23:23:49.309490 26815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:33663 every 8 connection(s)
I20260809 23:23:49.309775 26740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:49.310599 26816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:49.311946 26816 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:23:49.314671 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 26740
I20260809 23:23:49.314754 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:49.314960 1966 external_mini_cluster.cc:1428] Setting key d86b148bbce6aaffc8492784abc8bc3a
Aug 09 23:23:49 dist-test-slave-6nmv krb5kdc[26725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317829, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:49.320896 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.312480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:33663 (local address 127.0.0.1:53250)
0809 23:23:49.312663 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.312702 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:49.313165 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:49.313422 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:49.313424 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:49.313690 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:49.313828 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.313875 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.314845 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.314846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.315498 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.315500 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.316043 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.316044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.316112 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.316579 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:49.316586 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:49.317888 (+ 1302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:49.319515 (+ 1627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.319521 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.319523 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.319699 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.319946 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.319947 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.319947 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.320029 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.320339 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:49.320343 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:49.320400 (+ 57us) client_negotiation.cc:769] Sending connection context
0809 23:23:49.320512 (+ 112us) client_negotiation.cc:240] Negotiation successful
0809 23:23:49.320749 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":115,"thread_start_us":81,"threads_started":1}
I20260809 23:23:49.320912 26819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.312514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53250 (local address 127.1.235.190:33663)
0809 23:23:49.312671 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.312679 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.312824 (+ 145us) server_negotiation.cc:407] Connection header received
0809 23:23:49.313306 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.313312 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.313328 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.313415 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.313967 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.314705 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.315598 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.315928 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.316056 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.317975 (+ 1919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:49.317982 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:49.317982 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:49.317988 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:49.319421 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.319788 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.319791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.319791 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.319865 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.320092 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.320093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.320094 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.320276 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:49.320354 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:49.320545 (+ 191us) server_negotiation.cc:299] Negotiation successful
0809 23:23:49.320686 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":75,"threads_started":1}
I20260809 23:23:49.321527 26816 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:23:49.321898 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.321722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:37017 (local address 127.0.0.1:38356)
0809 23:23:49.321792 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.321869 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:37017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 23:23:49.322063 26759 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.235.189:37017: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.1.235.189@KRBTEST.COM; defaulting to no policy
I20260809 23:23:49.322449 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.322351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:37017 (local address 127.0.0.1:38370)
0809 23:23:49.322387 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.322426 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:37017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260809 23:23:49.322544 26816 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.189:37017: Network error: Client connection negotiation failed: client connection to 127.1.235.189:37017: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.189.keytab.
Entry for principal kudu/127.1.235.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.189.keytab.
I20260809 23:23:49.338347 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.189:37017
--webserver_interface=127.1.235.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.189.keytab
--principal=kudu/127.1.235.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:35809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:33663,127.1.235.189:37017,127.1.235.188:45311
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:23:49.371752 26816 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } attempt: 1
I20260809 23:23:49.372224 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.372098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:37017 (local address 127.0.0.1:38386)
0809 23:23:49.372165 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.372199 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:37017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 23:23:49.372637 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.372551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:37017 (local address 127.0.0.1:38400)
0809 23:23:49.372596 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.372620 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:37017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 23:23:49.372759 26816 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.189:37017: Network error: Client connection negotiation failed: client connection to 127.1.235.189:37017: connect: Connection refused (error 111)
W20260809 23:23:49.414855 26823 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 23:23:49.415012 26823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:49.415026 26823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:49.415042 26823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:49.415979 26823 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:49.416013 26823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:49.416028 26823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:49.416039 26823 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:49.416051 26823 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:49.417361 26823 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:35809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:33663,127.1.235.189:37017,127.1.235.188:45311
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.189.keytab
--principal=kudu/127.1.235.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.189:37017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.235.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26823
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:49.417523 26823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:49.417657 26823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:49.421619 26828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:49.421701 26830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:49.421763 26832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:49.421774 26823 server_base.cc:1034] running on GCE node
I20260809 23:23:49.422014 26823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:49.422314 26823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:49.423465 26823 hybrid_clock.cc:648] HybridClock initialized: now 1786317829423445 us; error 34 us; skew 500 ppm
Aug 09 23:23:49 dist-test-slave-6nmv krb5kdc[26725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317829, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:49.425673 26823 init.cc:377] Logged in from keytab as kudu/127.1.235.189@KRBTEST.COM (short username kudu)
I20260809 23:23:49.426151 26823 webserver.cc:460] Webserver started at http://127.1.235.189:46267/ using document root <none> and password file <none>
I20260809 23:23:49.426469 26823 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:49.426517 26823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:49.426666 26823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:49.427572 26823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-1/data/instance:
uuid: "8b87948dae724950a7a2648017af386c"
format_stamp: "Formatted at 2026-08-09 23:23:49 on dist-test-slave-6nmv"
server_key: "775df398fefe69da5718b67dc274af98"
server_key_iv: "3e8030ae3fea8fcee86eaaba937581d5"
server_key_version: "encryptionkey@0"
I20260809 23:23:49.427889 26823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-1/wal/instance:
uuid: "8b87948dae724950a7a2648017af386c"
format_stamp: "Formatted at 2026-08-09 23:23:49 on dist-test-slave-6nmv"
server_key: "775df398fefe69da5718b67dc274af98"
server_key_iv: "3e8030ae3fea8fcee86eaaba937581d5"
server_key_version: "encryptionkey@0"
I20260809 23:23:49.429056 26823 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:23:49.429754 26839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:49.429939 26823 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:23:49.430019 26823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-1/wal
uuid: "8b87948dae724950a7a2648017af386c"
format_stamp: "Formatted at 2026-08-09 23:23:49 on dist-test-slave-6nmv"
server_key: "775df398fefe69da5718b67dc274af98"
server_key_iv: "3e8030ae3fea8fcee86eaaba937581d5"
server_key_version: "encryptionkey@0"
I20260809 23:23:49.430104 26823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:49.440920 26816 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } attempt: 2
I20260809 23:23:49.441260 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.441153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:37017 (local address 127.0.0.1:38416)
0809 23:23:49.441203 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.441236 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:37017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 23:23:49.441655 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.441576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:37017 (local address 127.0.0.1:38426)
0809 23:23:49.441616 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.441640 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:37017: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260809 23:23:49.441753 26816 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.189:37017: Network error: Client connection negotiation failed: client connection to 127.1.235.189:37017: connect: Connection refused (error 111)
I20260809 23:23:49.451154 26823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:49.452951 26823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:49.453050 26823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:49.457020 26823 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.189:37017
I20260809 23:23:49.457083 26895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.189:37017 every 8 connection(s)
I20260809 23:23:49.457417 26823 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-1/data/info.pb
I20260809 23:23:49.458302 26896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:49.459712 26896 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:23:49.462692 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 26823
I20260809 23:23:49.462777 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-1/wal/instance
I20260809 23:23:49.462932 1966 external_mini_cluster.cc:1428] Setting key 5d77d9b2d4d443f07d329c57e85e85b2
Aug 09 23:23:49 dist-test-slave-6nmv krb5kdc[26725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317829, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.189@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:49.468745 26819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.460337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53262 (local address 127.1.235.190:33663)
0809 23:23:49.460402 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.460404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.460578 (+ 174us) server_negotiation.cc:407] Connection header received
0809 23:23:49.461024 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.461024 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.461034 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.461084 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.461577 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.462049 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.463087 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.463253 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.463300 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.465863 (+ 2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:49.465864 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:49.465864 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:49.465872 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:49.467470 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.467848 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.467849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.467850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.467918 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.468127 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.468128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.468129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.468263 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:49.468332 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:49.468543 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 23:23:49.468626 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260809 23:23:49.468813 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.460293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:33663 (local address 127.0.0.1:53262)
0809 23:23:49.460468 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.460506 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:49.460920 (+ 414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:49.461129 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:49.461131 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:49.461339 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:49.461515 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.461518 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.462121 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.462121 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.463014 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.463017 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.463338 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.463340 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.463476 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.463866 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:49.463875 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:49.465741 (+ 1866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:49.467564 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.467571 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.467573 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.467777 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.467983 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.467983 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.467983 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.468067 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.468324 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:49.468328 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:49.468420 (+ 92us) client_negotiation.cc:769] Sending connection context
0809 23:23:49.468486 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 23:23:49.468621 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":82,"threads_started":1}
I20260809 23:23:49.469466 26896 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.235.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.188@KRBTEST.COM" created.
Aug 09 23:23:49 dist-test-slave-6nmv krb5kdc[26725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317829, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.189@KRBTEST.COM for kudu/127.1.235.189@KRBTEST.COM
I20260809 23:23:49.478343 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.469688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:37017 (local address 127.0.0.1:38434)
0809 23:23:49.469737 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.469747 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:49.469788 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:49.470058 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:49.470059 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:49.470203 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:49.470255 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.470256 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.471061 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.471062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.471801 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.471803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.472254 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.472255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.472330 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.472612 (+ 282us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:49.472616 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:49.475223 (+ 2607us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:49.477311 (+ 2088us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.477311 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.477312 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.477514 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.477737 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.477737 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.477738 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.477794 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.478132 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:49.478133 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:49.478164 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 23:23:49.478205 (+ 41us) client_negotiation.cc:240] Negotiation successful
0809 23:23:49.478282 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 23:23:49.478611 26900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.469736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38434 (local address 127.1.235.189:37017)
0809 23:23:49.469907 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.469911 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.469930 (+ 19us) server_negotiation.cc:407] Connection header received
0809 23:23:49.469950 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.469952 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.469963 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.470032 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.470329 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.470973 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.471875 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.472175 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.472232 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.475299 (+ 3067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:49.475306 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:49.475306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:49.475312 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:49.477233 (+ 1921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.477601 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.477604 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.477604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.477676 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.477887 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.477888 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.477888 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.478057 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:49.478152 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:49.478277 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 23:23:49.478367 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":135,"threads_started":1}
I20260809 23:23:49.479143 26896 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:23:49.479437 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.479342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:45311 (local address 127.0.0.1:57838)
0809 23:23:49.479382 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.479421 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260809 23:23:49.479593 26843 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.235.188:45311: connect: Connection refused (error 111)
I20260809 23:23:49.479956 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.479892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:45311 (local address 127.0.0.1:57852)
0809 23:23:49.479923 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.479943 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260809 23:23:49.480094 26896 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.188:45311: Network error: Client connection negotiation failed: client connection to 127.1.235.188:45311: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.188.keytab.
Entry for principal kudu/127.1.235.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.188.keytab.
I20260809 23:23:49.488555 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.188:45311
--webserver_interface=127.1.235.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.188.keytab
--principal=kudu/127.1.235.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:35809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:33663,127.1.235.189:37017,127.1.235.188:45311
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:23:49.529321 26896 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } attempt: 1
I20260809 23:23:49.529690 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.529584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:45311 (local address 127.0.0.1:57862)
0809 23:23:49.529636 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.529666 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 23:23:49.529984 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.529897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:45311 (local address 127.0.0.1:57870)
0809 23:23:49.529939 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.529962 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 23:23:49.530078 26896 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.188:45311: Network error: Client connection negotiation failed: client connection to 127.1.235.188:45311: connect: Connection refused (error 111)
I20260809 23:23:49.532922 26816 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } attempt: 3
Aug 09 23:23:49 dist-test-slave-6nmv krb5kdc[26725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317829, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for kudu/127.1.235.189@KRBTEST.COM
I20260809 23:23:49.539383 26900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.533227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38436 (local address 127.1.235.189:37017)
0809 23:23:49.533296 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.533299 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.533308 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:23:49.533362 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.533363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.533386 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.533443 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.533719 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.534226 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.534884 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.535098 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.535165 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.537122 (+ 1957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:49.537123 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:49.537123 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:49.537130 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:49.538306 (+ 1176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.538663 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.538664 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.538665 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.538735 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.538924 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.538925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.538926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.539027 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:49.539098 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:49.539236 (+ 138us) server_negotiation.cc:299] Negotiation successful
0809 23:23:49.539306 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 23:23:49.539402 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.533184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:37017 (local address 127.0.0.1:38436)
0809 23:23:49.533225 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.533234 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:49.533297 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:49.533449 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:49.533450 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:49.533588 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:49.533645 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.533646 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.534320 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.534321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.534793 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.534795 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.535163 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.535164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.535239 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.535651 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:49.535654 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:49.537044 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:49.538424 (+ 1380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.538425 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.538425 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.538587 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.538802 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.538803 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.538803 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.538865 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.539090 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:49.539091 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:49.539133 (+ 42us) client_negotiation.cc:769] Sending connection context
0809 23:23:49.539215 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 23:23:49.539308 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260809 23:23:49.539950 26816 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:23:49.540243 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.540165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:45311 (local address 127.0.0.1:57876)
0809 23:23:49.540203 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.540227 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260809 23:23:49.540556 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.540466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:45311 (local address 127.0.0.1:57890)
0809 23:23:49.540511 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.540532 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 23:23:49.540629 26816 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.188:45311: Network error: Client connection negotiation failed: client connection to 127.1.235.188:45311: connect: Connection refused (error 111)
W20260809 23:23:49.563858 26903 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 23:23:49.564020 26903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:49.564036 26903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:49.564080 26903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:49.565114 26903 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:49.565150 26903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:49.565164 26903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:49.565201 26903 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:49.565230 26903 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:49.566684 26903 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:35809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:33663,127.1.235.189:37017,127.1.235.188:45311
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.188.keytab
--principal=kudu/127.1.235.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.188:45311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.235.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:49.566937 26903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:49.567157 26903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:49.571211 26911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:49.571218 26908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:49.571241 26903 server_base.cc:1034] running on GCE node
W20260809 23:23:49.571223 26909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:49.571575 26903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:49.571767 26816 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } attempt: 1
I20260809 23:23:49.571911 26903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:49.572110 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.571987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:45311 (local address 127.0.0.1:57896)
0809 23:23:49.572044 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.572078 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260809 23:23:49.572448 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.572353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:45311 (local address 127.0.0.1:57904)
0809 23:23:49.572397 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.572420 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:45311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 23:23:49.572561 26816 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.188:45311: Network error: Client connection negotiation failed: client connection to 127.1.235.188:45311: connect: Connection refused (error 111)
I20260809 23:23:49.573076 26903 hybrid_clock.cc:648] HybridClock initialized: now 1786317829573060 us; error 28 us; skew 500 ppm
Aug 09 23:23:49 dist-test-slave-6nmv krb5kdc[26725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317829, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:49.575026 26903 init.cc:377] Logged in from keytab as kudu/127.1.235.188@KRBTEST.COM (short username kudu)
I20260809 23:23:49.575392 26903 webserver.cc:460] Webserver started at http://127.1.235.188:36197/ using document root <none> and password file <none>
I20260809 23:23:49.575556 26903 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:49.575590 26903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:49.575686 26903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:49.576599 26903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-2/data/instance:
uuid: "7d2a50a8685b4c72b112d5ce84241876"
format_stamp: "Formatted at 2026-08-09 23:23:49 on dist-test-slave-6nmv"
server_key: "b16fd45718a2acd503ae537a1d53afbc"
server_key_iv: "6b15d35aee6c31cbeb55287a88e6ff0e"
server_key_version: "encryptionkey@0"
I20260809 23:23:49.576877 26903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-2/wal/instance:
uuid: "7d2a50a8685b4c72b112d5ce84241876"
format_stamp: "Formatted at 2026-08-09 23:23:49 on dist-test-slave-6nmv"
server_key: "b16fd45718a2acd503ae537a1d53afbc"
server_key_iv: "6b15d35aee6c31cbeb55287a88e6ff0e"
server_key_version: "encryptionkey@0"
I20260809 23:23:49.578166 26903 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:23:49.578837 26920 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:49.578986 26903 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260809 23:23:49.579058 26903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-2/wal
uuid: "7d2a50a8685b4c72b112d5ce84241876"
format_stamp: "Formatted at 2026-08-09 23:23:49 on dist-test-slave-6nmv"
server_key: "b16fd45718a2acd503ae537a1d53afbc"
server_key_iv: "6b15d35aee6c31cbeb55287a88e6ff0e"
server_key_version: "encryptionkey@0"
I20260809 23:23:49.579104 26903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:49.588814 26903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:49.590310 26903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:49.590401 26903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:49.593726 26903 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.188:45311
I20260809 23:23:49.593801 26981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.188:45311 every 8 connection(s)
I20260809 23:23:49.594136 26903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-2/data/info.pb
I20260809 23:23:49.595052 26982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:49.596490 26982 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:23:49.598196 26896 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } attempt: 2
Aug 09 23:23:49 dist-test-slave-6nmv krb5kdc[26725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317829, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.188@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
Aug 09 23:23:49 dist-test-slave-6nmv krb5kdc[26725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317829, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.189@KRBTEST.COM for kudu/127.1.235.188@KRBTEST.COM
I20260809 23:23:49.602490 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 26903
I20260809 23:23:49.602576 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786317539151495-1966-0/minicluster-data/master-2/wal/instance
I20260809 23:23:49.602777 1966 external_mini_cluster.cc:1428] Setting key 9b45fe7d328886ff2984795037798596
I20260809 23:23:49.605345 26986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.597055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:33663 (local address 127.0.0.1:53272)
0809 23:23:49.597191 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.597219 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:49.597584 (+ 365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:49.597782 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:49.597785 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:49.598047 (+ 262us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:49.598201 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.598205 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.598933 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.598934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.599581 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.599584 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.600070 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.600071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.600166 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.600688 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:49.600696 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:49.602105 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:49.603854 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.603871 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.603873 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.604201 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.604403 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.604404 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.604405 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.604531 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.604770 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:49.604776 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:49.604928 (+ 152us) client_negotiation.cc:769] Sending connection context
0809 23:23:49.605021 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 23:23:49.605160 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":71,"threads_started":1}
I20260809 23:23:49.605648 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.598421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:45311 (local address 127.0.0.1:57920)
0809 23:23:49.598469 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.598476 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:49.598504 (+ 28us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:49.598749 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:49.598750 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:49.598873 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:49.598912 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.598913 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.599724 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.599725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.600289 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.600291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.600732 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.600733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.600799 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.601155 (+ 356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:49.601158 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:49.602579 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:49.604589 (+ 2010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.604590 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.604591 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.604800 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.604997 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.604998 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.604998 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.605067 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.605351 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:49.605352 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:49.605396 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 23:23:49.605469 (+ 73us) client_negotiation.cc:240] Negotiation successful
0809 23:23:49.605556 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260809 23:23:49.605736 26819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.597061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53272 (local address 127.1.235.190:33663)
0809 23:23:49.597098 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.597100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.597292 (+ 192us) server_negotiation.cc:407] Connection header received
0809 23:23:49.597678 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.597679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.597687 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.597742 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.598299 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.598830 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.599694 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.599921 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.599988 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.602183 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:49.602184 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:49.602184 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:49.602189 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:49.603792 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.604271 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.604272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.604272 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.604326 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.604596 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.604597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.604597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.604698 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:49.604767 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:49.605579 (+ 812us) server_negotiation.cc:299] Negotiation successful
0809 23:23:49.605653 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 23:23:49.606017 26987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.598479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57920 (local address 127.1.235.188:45311)
0809 23:23:49.598623 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.598626 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.598639 (+ 13us) server_negotiation.cc:407] Connection header received
0809 23:23:49.598653 (+ 14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.598654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.598666 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.598743 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.598989 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.599630 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.600364 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.600650 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.600729 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.602669 (+ 1940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:49.602676 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:49.602676 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:49.602691 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:49.604490 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.604878 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.604881 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.604881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.604939 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.605144 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.605145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.605145 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.605275 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:49.605349 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:49.605799 (+ 450us) server_negotiation.cc:299] Negotiation successful
0809 23:23:49.605914 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":123,"thread_start_us":90,"threads_started":1}
I20260809 23:23:49.606220 26982 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:23:49.607338 26896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c: Bootstrap starting.
I20260809 23:23:49.608043 26896 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c: Neither blocks nor log segments found. Creating new log.
Aug 09 23:23:49 dist-test-slave-6nmv krb5kdc[26725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.188@KRBTEST.COM
I20260809 23:23:49.608296 26896 log.cc:824] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:49.609066 26896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c: No bootstrap required, opened a new log
I20260809 23:23:49.611032 26896 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } }
I20260809 23:23:49.611148 26896 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b87948dae724950a7a2648017af386c, State: Initialized, Role: FOLLOWER
I20260809 23:23:49.611228 26896 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } }
I20260809 23:23:49.611536 26896 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:49.611691 26991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } } }
I20260809 23:23:49.611784 26991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c [sys.catalog]: This master's current role is: FOLLOWER
Aug 09 23:23:49 dist-test-slave-6nmv krb5kdc[26725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317829, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.188@KRBTEST.COM for kudu/127.1.235.189@KRBTEST.COM
I20260809 23:23:49.612342 26988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.603076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57936 (local address 127.1.235.188:45311)
0809 23:23:49.603200 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.603202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.603348 (+ 146us) server_negotiation.cc:407] Connection header received
0809 23:23:49.603435 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.603436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.603446 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.603511 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.604290 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.604847 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.605798 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.606105 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.606156 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.608835 (+ 2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:49.608836 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:49.608836 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:49.608843 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:49.610745 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.611162 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.611163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.611163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.611223 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.611452 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.611453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.611453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.611632 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:49.611805 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:49.612120 (+ 315us) server_negotiation.cc:299] Negotiation successful
0809 23:23:49.612195 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":60,"threads_started":1}
W20260809 23:23:49.613324 27003 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 23:23:49.613653 27003 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:23:49.615644 26986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.606454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:37017 (local address 127.0.0.1:38446)
0809 23:23:49.608517 (+ 2063us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.608525 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:49.608582 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:49.608681 (+ 99us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:49.608681 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:49.608803 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:49.608848 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.608849 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.609587 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.609588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.610263 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.610265 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.610733 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.610734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.610794 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.611123 (+ 329us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:49.611127 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:49.612521 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:49.614560 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.614561 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.614561 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.614790 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.615014 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.615015 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.615015 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.615073 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.615371 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:49.615372 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:49.615410 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 23:23:49.615474 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 23:23:49.615561 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2050}
I20260809 23:23:49.613778 26823 master_runner.cc:186] Error getting master registration for 127.1.235.190:33663: OK, instance_id { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" instance_seqno: 1786317829308521 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 23:23:49.616003 26900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.606499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38446 (local address 127.1.235.189:37017)
0809 23:23:49.606533 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.606535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.608573 (+ 2038us) server_negotiation.cc:407] Connection header received
0809 23:23:49.608631 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.608631 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.608639 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.608680 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.608922 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.609500 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.610362 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.610637 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.610688 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.612623 (+ 1935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:49.612625 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:49.612625 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:49.612632 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:49.614456 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.614879 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.614880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.614881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.614940 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.615150 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.615151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.615152 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.615290 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:49.615345 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:49.615808 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 23:23:49.615914 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260809 23:23:49.616079 26823 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 23:23:49.616463 26982 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 23:23:49 dist-test-slave-6nmv krb5kdc[26725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
Aug 09 23:23:49 dist-test-slave-6nmv krb5kdc[26725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317829, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.188@KRBTEST.COM for kudu/127.1.235.188@KRBTEST.COM
I20260809 23:23:49.622166 26819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.613760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53276 (local address 127.1.235.190:33663)
0809 23:23:49.613799 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.613801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.613967 (+ 166us) server_negotiation.cc:407] Connection header received
0809 23:23:49.614076 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.614077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.614088 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.614123 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.614827 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.615427 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.616373 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.616628 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.616699 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.619138 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:49.619139 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:49.619139 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:49.619145 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:49.620720 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.621088 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.621090 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.621090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.621153 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.621594 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.621595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.621595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.621726 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:49.621929 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:49.621975 (+ 46us) server_negotiation.cc:299] Negotiation successful
0809 23:23:49.622056 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:23:49.623641 26986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.616725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:45311 (local address 127.0.0.1:57942)
0809 23:23:49.616803 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.616813 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:49.616852 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:49.617061 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:49.617061 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:49.617187 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:49.617209 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.617210 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.617846 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.617847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.618278 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.618279 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.618710 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.618710 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.618754 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.619150 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:49.619154 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:49.620345 (+ 1191us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:49.622184 (+ 1839us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.622185 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.622185 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.622625 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.622987 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.622988 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.622988 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.623051 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.623338 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:49.623338 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:49.623374 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 23:23:49.623445 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 23:23:49.623535 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 23:23:49.623693 26988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.616808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57942 (local address 127.1.235.188:45311)
0809 23:23:49.616961 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.616962 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.616969 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:23:49.616984 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.616985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.616993 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.617059 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.617280 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.617740 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.618375 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.618601 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.618668 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.620443 (+ 1775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:49.620444 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:49.620444 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:49.620451 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:49.622031 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.622816 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.622818 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.622818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.622908 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.623129 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.623130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.623130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.623259 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:49.623345 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:49.623479 (+ 134us) server_negotiation.cc:299] Negotiation successful
0809 23:23:49.623583 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":124}
I20260809 23:23:49.624850 26982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876: Bootstrap starting.
I20260809 23:23:49.625514 26982 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:49.625952 26982 log.cc:824] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:49.626847 26982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876: No bootstrap required, opened a new log
Aug 09 23:23:49 dist-test-slave-6nmv krb5kdc[26725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.189@KRBTEST.COM
I20260809 23:23:49.629241 26982 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } }
I20260809 23:23:49.629388 26982 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2a50a8685b4c72b112d5ce84241876, State: Initialized, Role: FOLLOWER
I20260809 23:23:49.629479 26982 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } }
I20260809 23:23:49.629804 26982 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:49.629760 27006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } } }
I20260809 23:23:49.629891 27006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 23:23:49.632030 26900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.622834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38460 (local address 127.1.235.189:37017)
0809 23:23:49.622875 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.622876 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.622884 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:23:49.622903 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.622904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.622914 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.622980 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.623542 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.624147 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.624998 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.625252 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.625314 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.628492 (+ 3178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:49.628494 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:49.628494 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:49.628502 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:49.630440 (+ 1938us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.630879 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.630880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.630881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.630946 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.631176 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.631176 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.631177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.631307 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:49.631450 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:49.631847 (+ 397us) server_negotiation.cc:299] Negotiation successful
0809 23:23:49.631956 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260809 23:23:49.632087 27018 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 23:23:49.632139 27018 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:23:49.631875 26903 master_runner.cc:186] Error getting master registration for 127.1.235.190:33663: OK, instance_id { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" instance_seqno: 1786317829308521 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 23:23:49.633999 26903 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 23:23:49.634001 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:49.635155 26786 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "95f760d1769742e3a8e1feeb035c8439"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53276
I20260809 23:23:49.647709 26816 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } attempt: 2
Aug 09 23:23:49 dist-test-slave-6nmv krb5kdc[26725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317829, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for kudu/127.1.235.188@KRBTEST.COM
I20260809 23:23:49.655439 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.647962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:45311 (local address 127.0.0.1:57954)
0809 23:23:49.648013 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:49.648022 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:49.648054 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:49.648241 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:49.648243 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:49.648419 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:49.648465 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.648466 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.649334 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.649335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.650130 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:49.650132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.650585 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.650586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:49.650646 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.651079 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:49.651084 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:49.652553 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:49.654443 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.654444 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.654444 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.654650 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.654859 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:49.654860 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:49.654860 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:49.654914 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:49.655170 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:49.655171 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:49.655210 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 23:23:49.655271 (+ 61us) client_negotiation.cc:240] Negotiation successful
0809 23:23:49.655353 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 23:23:49.655472 26988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.648061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57954 (local address 127.1.235.188:45311)
0809 23:23:49.648098 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.648099 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.648107 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:23:49.648127 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.648127 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.648136 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.648198 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.648548 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.649241 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.650232 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.650499 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.650573 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.652654 (+ 2081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:49.652655 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:49.652656 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:49.652662 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:49.654358 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.654724 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.654725 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.654725 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.654786 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.654975 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.654976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.654976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.655093 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:49.655167 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:49.655309 (+ 142us) server_negotiation.cc:299] Negotiation successful
0809 23:23:49.655386 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 23:23:49.657562 26816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439: Bootstrap starting.
I20260809 23:23:49.658283 26816 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:49.658577 26816 log.cc:824] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:49.659438 26816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439: No bootstrap required, opened a new log
I20260809 23:23:49.660749 26816 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } }
I20260809 23:23:49.660887 26816 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95f760d1769742e3a8e1feeb035c8439, State: Initialized, Role: FOLLOWER
I20260809 23:23:49.660965 26816 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } }
I20260809 23:23:49.661275 27021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } } }
I20260809 23:23:49.661283 26816 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:49.661321 26786 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 23:23:49.661532 26786 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:49.662365 26786 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } }
I20260809 23:23:49.662647 26786 leader_election.cc:288] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [CANDIDATE]: Term 1 election: Requested vote from peers 8b87948dae724950a7a2648017af386c (127.1.235.189:37017), 7d2a50a8685b4c72b112d5ce84241876 (127.1.235.188:45311)
I20260809 23:23:49.663058 26867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "95f760d1769742e3a8e1feeb035c8439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8b87948dae724950a7a2648017af386c"
I20260809 23:23:49.663214 26867 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:49.664077 26951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "95f760d1769742e3a8e1feeb035c8439" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7d2a50a8685b4c72b112d5ce84241876"
I20260809 23:23:49.664206 26867 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f760d1769742e3a8e1feeb035c8439 in term 1.
I20260809 23:23:49.664206 26951 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:49.664439 26759 leader_election.cc:302] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b87948dae724950a7a2648017af386c, 95f760d1769742e3a8e1feeb035c8439; no voters:
I20260809 23:23:49.664685 27041 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:49.664841 27041 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [term 1 LEADER]: Becoming Leader. State: Replica: 95f760d1769742e3a8e1feeb035c8439, State: Running, Role: LEADER
I20260809 23:23:49.664945 27041 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } }
I20260809 23:23:49.665141 26951 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95f760d1769742e3a8e1feeb035c8439 in term 1.
I20260809 23:23:49.665357 27041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95f760d1769742e3a8e1feeb035c8439. Latest consensus state: current_term: 1 leader_uuid: "95f760d1769742e3a8e1feeb035c8439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } } }
I20260809 23:23:49.665436 27041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:49.665756 27045 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:49.666242 26740 master_runner.cc:263] No leader master found from master 95f760d1769742e3a8e1feeb035c8439
I20260809 23:23:49.666319 26740 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 23:23:49.666249 27021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 23:23:49.666227 27045 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:49.668113 26951 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876 [term 1 FOLLOWER]: Refusing update from remote peer 95f760d1769742e3a8e1feeb035c8439: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:23:49.668442 27021 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:23:49.668932 26867 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c [term 1 FOLLOWER]: Refusing update from remote peer 95f760d1769742e3a8e1feeb035c8439: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:23:49.669354 27021 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:23:49.669744 27006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95f760d1769742e3a8e1feeb035c8439. Latest consensus state: current_term: 1 leader_uuid: "95f760d1769742e3a8e1feeb035c8439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } } }
I20260809 23:23:49.669816 27006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 23:23:49.670593 26991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95f760d1769742e3a8e1feeb035c8439. Latest consensus state: current_term: 1 leader_uuid: "95f760d1769742e3a8e1feeb035c8439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } } }
I20260809 23:23:49.670668 26991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c [sys.catalog]: This master's current role is: FOLLOWER
I20260809 23:23:49.671231 27021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "95f760d1769742e3a8e1feeb035c8439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } } }
I20260809 23:23:49.671298 27021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:49.671648 27006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "95f760d1769742e3a8e1feeb035c8439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } } }
I20260809 23:23:49.671715 27006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 23:23:49.671945 27047 mvcc.cc:205] Tried to move back new op lower bound from 7316757830318288896 to 7316757830308413440. Current Snapshot: MvccSnapshot[applied={T|T < 7316757830318288896}]
I20260809 23:23:49.672435 27048 mvcc.cc:205] Tried to move back new op lower bound from 7316757830318288896 to 7316757830308413440. Current Snapshot: MvccSnapshot[applied={T|T < 7316757830318288896}]
I20260809 23:23:49.673460 27045 catalog_manager.cc:1347] Generated new cluster ID: 17a17fbee1a247b5aff153c04532dbce
I20260809 23:23:49.673514 27045 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:49.673758 27043 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "95f760d1769742e3a8e1feeb035c8439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } } }
I20260809 23:23:49.674197 26991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "95f760d1769742e3a8e1feeb035c8439" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95f760d1769742e3a8e1feeb035c8439" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 33663 } } peers { permanent_uuid: "8b87948dae724950a7a2648017af386c" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 37017 } } peers { permanent_uuid: "7d2a50a8685b4c72b112d5ce84241876" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 45311 } } }
I20260809 23:23:49.674273 26991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c [sys.catalog]: This master's current role is: FOLLOWER
I20260809 23:23:49.674448 27043 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:49.674547 27050 mvcc.cc:205] Tried to move back new op lower bound from 7316757830318288896 to 7316757830308413440. Current Snapshot: MvccSnapshot[applied={T|T < 7316757830318288896 or (T in {7316757830318288896})}]
I20260809 23:23:49.682650 26819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.674895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53280 (local address 127.1.235.190:33663)
0809 23:23:49.674931 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.674934 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.675061 (+ 127us) server_negotiation.cc:407] Connection header received
0809 23:23:49.675160 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.675161 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.675171 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.675200 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.675989 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.676691 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.677831 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.678107 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.678146 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.679867 (+ 1721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:49.679868 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:49.679869 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:49.679874 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:49.681417 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.681832 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.681833 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.681834 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.681907 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.682112 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.682113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.682113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.682221 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:49.682284 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:49.682474 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 23:23:49.682573 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 23:23:49.687103 27045 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:49.687738 27045 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:49.700209 26988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.680909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57956 (local address 127.1.235.188:45311)
0809 23:23:49.680942 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.680944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.680950 (+ 6us) server_negotiation.cc:407] Connection header received
0809 23:23:49.680967 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.680968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.680976 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.681027 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.691721 (+ 10694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.692369 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.695434 (+ 3065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.695717 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.695782 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.697488 (+ 1706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:49.697489 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:49.697489 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:49.697495 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:49.699063 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.699436 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.699437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.699437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.699488 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.699670 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.699670 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.699671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.699784 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:49.699856 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:49.700053 (+ 197us) server_negotiation.cc:299] Negotiation successful
0809 23:23:49.700126 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 23:23:49.701900 27045 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95f760d1769742e3a8e1feeb035c8439: Generated new TSK 0
I20260809 23:23:49.702106 27045 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 23:23:49.706890 26900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:49.680708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38466 (local address 127.1.235.189:37017)
0809 23:23:49.680744 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.680746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.680753 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:23:49.680772 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.680772 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.680781 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.680837 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.690146 (+ 9309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.690756 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.693327 (+ 2571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:49.693614 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:49.693660 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:49.698747 (+ 5087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:49.698749 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:49.698749 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:49.698756 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:49.700455 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.706081 (+ 5626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.706082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.706083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.706144 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:49.706337 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:49.706338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:49.706338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:49.706455 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:49.706529 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:49.706728 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 23:23:49.706806 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260809 23:23:49.735639 26988 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:49.734626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57968 (local address 127.1.235.188:45311)
0809 23:23:49.734666 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.734669 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.735011 (+ 342us) server_negotiation.cc:407] Connection header received
0809 23:23:49.735132 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.735132 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.735142 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.735170 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.735579 (+ 409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57968: BlockingRecv error: recv got EOF from 127.0.0.1:57968 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 23:23:49.736860 26819 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:49.736194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53296 (local address 127.1.235.190:33663)
0809 23:23:49.736233 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.736235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.736349 (+ 114us) server_negotiation.cc:407] Connection header received
0809 23:23:49.736440 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.736441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.736451 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.736481 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.736796 (+ 315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53296: BlockingRecv error: recv got EOF from 127.0.0.1:53296 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260809 23:23:49.737849 26900 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:49.737262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38472 (local address 127.1.235.189:37017)
0809 23:23:49.737295 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.737296 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.737392 (+ 96us) server_negotiation.cc:407] Connection header received
0809 23:23:49.737471 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.737472 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.737480 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.737505 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.737775 (+ 270us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38472: BlockingRecv error: recv got EOF from 127.0.0.1:38472 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 23:23:49.740015 26900 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:49.739273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38482 (local address 127.1.235.189:37017)
0809 23:23:49.739304 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.739305 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.739474 (+ 169us) server_negotiation.cc:407] Connection header received
0809 23:23:49.739583 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.739583 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.739609 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.739650 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.739965 (+ 315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38482: BlockingRecv error: recv got EOF from 127.0.0.1:38482 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260809 23:23:49.742928 26900 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:49.742275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38490 (local address 127.1.235.189:37017)
0809 23:23:49.742303 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.742305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.742505 (+ 200us) server_negotiation.cc:407] Connection header received
0809 23:23:49.742589 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.742590 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.742598 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.742622 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.742892 (+ 270us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38490: BlockingRecv error: recv got EOF from 127.0.0.1:38490 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260809 23:23:49.746810 26900 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:49.746075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38502 (local address 127.1.235.189:37017)
0809 23:23:49.746107 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.746109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.746335 (+ 226us) server_negotiation.cc:407] Connection header received
0809 23:23:49.746427 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.746427 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.746437 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.746464 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.746771 (+ 307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38502: BlockingRecv error: recv got EOF from 127.0.0.1:38502 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260809 23:23:49.752588 26900 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:49.751899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38504 (local address 127.1.235.189:37017)
0809 23:23:49.751931 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.751933 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.752135 (+ 202us) server_negotiation.cc:407] Connection header received
0809 23:23:49.752216 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.752217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.752225 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.752249 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.752545 (+ 296us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38504: BlockingRecv error: recv got EOF from 127.0.0.1:38504 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260809 23:23:49.762531 26900 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:49.761763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38510 (local address 127.1.235.189:37017)
0809 23:23:49.761791 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.761793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.762033 (+ 240us) server_negotiation.cc:407] Connection header received
0809 23:23:49.762154 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.762155 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.762164 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.762188 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.762480 (+ 292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38510: BlockingRecv error: recv got EOF from 127.0.0.1:38510 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260809 23:23:49.780584 26900 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:49.779808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38522 (local address 127.1.235.189:37017)
0809 23:23:49.779843 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.779844 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.780104 (+ 260us) server_negotiation.cc:407] Connection header received
0809 23:23:49.780198 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.780199 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.780220 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.780244 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.780540 (+ 296us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38522: BlockingRecv error: recv got EOF from 127.0.0.1:38522 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 23:23:49.814487 26900 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:49.813794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38534 (local address 127.1.235.189:37017)
0809 23:23:49.813866 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.813868 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.813928 (+ 60us) server_negotiation.cc:407] Connection header received
0809 23:23:49.814005 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.814005 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.814017 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.814075 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.814438 (+ 363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38534: BlockingRecv error: recv got EOF from 127.0.0.1:38534 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 23:23:49.880447 26900 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:49.879751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38550 (local address 127.1.235.189:37017)
0809 23:23:49.879813 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:49.879814 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:49.879927 (+ 113us) server_negotiation.cc:407] Connection header received
0809 23:23:49.879990 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:49.879990 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:49.880000 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:49.880056 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:49.880350 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38550: BlockingRecv error: recv got EOF from 127.0.0.1:38550 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260809 23:23:50.010497 26900 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:50.009726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38558 (local address 127.1.235.189:37017)
0809 23:23:50.009795 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:50.009797 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:50.009851 (+ 54us) server_negotiation.cc:407] Connection header received
0809 23:23:50.009962 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:50.009964 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:50.009984 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:50.010050 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:50.010417 (+ 367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38558: BlockingRecv error: recv got EOF from 127.0.0.1:38558 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260809 23:23:50.268496 26900 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:50.267751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38566 (local address 127.1.235.189:37017)
0809 23:23:50.267825 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:50.267827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:50.267838 (+ 11us) server_negotiation.cc:407] Connection header received
0809 23:23:50.267965 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:50.267967 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:50.267977 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:50.268045 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:50.268427 (+ 382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38566: BlockingRecv error: recv got EOF from 127.0.0.1:38566 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 23:23:50.614076 27003 catalog_manager.cc:1259] Loaded cluster ID: 17a17fbee1a247b5aff153c04532dbce
I20260809 23:23:50.614135 27003 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c: loading cluster ID for follower catalog manager: success
I20260809 23:23:50.614827 27003 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c: acquiring CA information for follower catalog manager: success
I20260809 23:23:50.615077 27003 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8b87948dae724950a7a2648017af386c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 23:23:50.632460 27018 catalog_manager.cc:1259] Loaded cluster ID: 17a17fbee1a247b5aff153c04532dbce
I20260809 23:23:50.632511 27018 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876: loading cluster ID for follower catalog manager: success
I20260809 23:23:50.633277 27018 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876: acquiring CA information for follower catalog manager: success
I20260809 23:23:50.633527 27018 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7d2a50a8685b4c72b112d5ce84241876: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 23:23:50.784358 27136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:50.781884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38568 (local address 127.1.235.189:37017)
0809 23:23:50.782003 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:50.782005 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:50.782034 (+ 29us) server_negotiation.cc:407] Connection header received
0809 23:23:50.782085 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:50.782085 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:50.782130 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:50.782196 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:23:50.782424 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:50.782974 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:50.783681 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:50.783859 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:50.783921 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:50.784045 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:23:50.784144 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:23:50.784198 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:50.784239 (+ 41us) server_negotiation.cc:299] Negotiation successful
0809 23:23:50.784255 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":63,"threads_started":1}
I20260809 23:23:50.788170 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:50.786193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57976 (local address 127.1.235.188:45311)
0809 23:23:50.786292 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:50.786294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:50.786319 (+ 25us) server_negotiation.cc:407] Connection header received
0809 23:23:50.786360 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:50.786360 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:50.786397 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:50.786472 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:23:50.786556 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:50.787032 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:50.787651 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:50.787813 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:50.787856 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:50.787966 (+ 110us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:23:50.788037 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:23:50.788090 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:50.788104 (+ 14us) server_negotiation.cc:299] Negotiation successful
0809 23:23:50.788118 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80,"thread_start_us":58,"threads_started":1}
I20260809 23:23:50.792224 27136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:50.789762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38576 (local address 127.1.235.189:37017)
0809 23:23:50.789829 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:50.789830 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:50.789896 (+ 66us) server_negotiation.cc:407] Connection header received
0809 23:23:50.789998 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:50.789999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:50.790010 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:50.790064 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:23:50.790186 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:50.790657 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:50.791461 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:50.791730 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:50.791832 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:50.791999 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:23:50.792027 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:23:50.792052 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:50.792144 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 23:23:50.792162 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:23:50.792315 27143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:50.789649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57978 (local address 127.1.235.188:45311)
0809 23:23:50.789702 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:50.789704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:50.789905 (+ 201us) server_negotiation.cc:407] Connection header received
0809 23:23:50.789959 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:50.789959 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:50.789969 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:50.790012 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:23:50.790159 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:50.790813 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:50.791642 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:50.791926 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:50.791981 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:50.792096 (+ 115us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:23:50.792122 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:23:50.792161 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:50.792220 (+ 59us) server_negotiation.cc:299] Negotiation successful
0809 23:23:50.792237 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:23:50.792961 27151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:50.789620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53300 (local address 127.1.235.190:33663)
0809 23:23:50.789780 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:50.789781 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:50.789884 (+ 103us) server_negotiation.cc:407] Connection header received
0809 23:23:50.790122 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:50.790123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:50.790172 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:50.790237 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:23:50.790349 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:50.791016 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:50.791946 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:50.792239 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:50.792298 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:50.792585 (+ 287us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:23:50.792676 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:23:50.792753 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:50.792847 (+ 94us) server_negotiation.cc:299] Negotiation successful
0809 23:23:50.792870 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":80,"threads_started":1}
I20260809 23:23:50.794543 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 26740
I20260809 23:23:50.806672 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 26823
I20260809 23:23:50.812525 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 26903
2026-08-09T23:23:50Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2745 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 23:23:50 dist-test-slave-6nmv krb5kdc[27156](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 23:23:50 dist-test-slave-6nmv krb5kdc[27156](info): set up 2 sockets
Aug 09 23:23:50 dist-test-slave-6nmv krb5kdc[27156](info): commencing operation
krb5kdc: starting...
W20260809 23:23:51.862536 1966 mini_kdc.cc:121] Time spent starting KDC: real 1.029s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/test-user.keytab.
Aug 09 23:23:51 dist-test-slave-6nmv krb5kdc[27156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T23:23:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T23:23:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.1.235.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
Entry for principal kudu/127.1.235.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab.
I20260809 23:23:51.968793 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:44079
--webserver_interface=127.1.235.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:33669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:44079,127.1.235.189:35697,127.1.235.188:33501
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 23:23:52.043784 27169 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 23:23:52.043985 27169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:52.044011 27169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:52.044047 27169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:52.045001 27169 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:52.045056 27169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:52.045112 27169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:52.045140 27169 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:52.045161 27169 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:52.046660 27169 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:33669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:44079,127.1.235.189:35697,127.1.235.188:33501
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.190.keytab
--principal=kudu/127.1.235.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.190:44079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.1.235.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:52.046931 27169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:52.047169 27169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 23:23:52.051488 27169 server_base.cc:1034] running on GCE node
W20260809 23:23:52.051471 27174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:52.051434 27175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:52.051471 27177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:52.051954 27169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:52.052264 27169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:52.053434 27169 hybrid_clock.cc:648] HybridClock initialized: now 1786317832053433 us; error 36 us; skew 500 ppm
Aug 09 23:23:52 dist-test-slave-6nmv krb5kdc[27156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317832, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:52.055912 27169 init.cc:377] Logged in from keytab as kudu/127.1.235.190@KRBTEST.COM (short username kudu)
I20260809 23:23:52.056311 27169 webserver.cc:460] Webserver started at http://127.1.235.190:36019/ using document root <none> and password file <none>
I20260809 23:23:52.056526 27169 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:52.056592 27169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:52.056738 27169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:52.057786 27169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-0/data/instance:
uuid: "c00ac86c51ca47e2896462451a20fda2"
format_stamp: "Formatted at 2026-08-09 23:23:52 on dist-test-slave-6nmv"
server_key: "2f5e84281d4c992e9c878bdb89cf222e"
server_key_iv: "2c3be780a0fbd349319fc99fddf0574a"
server_key_version: "encryptionkey@0"
I20260809 23:23:52.058203 27169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-0/wal/instance:
uuid: "c00ac86c51ca47e2896462451a20fda2"
format_stamp: "Formatted at 2026-08-09 23:23:52 on dist-test-slave-6nmv"
server_key: "2f5e84281d4c992e9c878bdb89cf222e"
server_key_iv: "2c3be780a0fbd349319fc99fddf0574a"
server_key_version: "encryptionkey@0"
I20260809 23:23:52.059450 27169 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260809 23:23:52.060092 27185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:52.060242 27169 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:52.060331 27169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-0/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-0/wal
uuid: "c00ac86c51ca47e2896462451a20fda2"
format_stamp: "Formatted at 2026-08-09 23:23:52 on dist-test-slave-6nmv"
server_key: "2f5e84281d4c992e9c878bdb89cf222e"
server_key_iv: "2c3be780a0fbd349319fc99fddf0574a"
server_key_version: "encryptionkey@0"
I20260809 23:23:52.060412 27169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:52.072279 27169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:52.073953 27169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:52.074103 27169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:52.077802 27169 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.190:44079
I20260809 23:23:52.077898 27244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.190:44079 every 8 connection(s)
I20260809 23:23:52.078263 27169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-0/data/info.pb
I20260809 23:23:52.079169 27245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:52.080574 27245 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:23:52.082762 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 27169
I20260809 23:23:52.082844 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-0/wal/instance
I20260809 23:23:52.083031 1966 external_mini_cluster.cc:1428] Setting key 0574ae023766b304b6ada1f1a3e50804
Aug 09 23:23:52 dist-test-slave-6nmv krb5kdc[27156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317832, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:52.090317 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.081153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44079 (local address 127.0.0.1:51360)
0809 23:23:52.081340 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.081378 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:52.081898 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:52.082172 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:52.082174 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:52.082432 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:52.082567 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.082590 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.083665 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.083666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.084683 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.084687 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.085324 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.085325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.085374 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.085883 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:52.085889 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:52.087212 (+ 1323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:52.089039 (+ 1827us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.089045 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.089046 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.089212 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.089446 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.089447 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.089447 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.089518 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.089936 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:52.089941 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:52.089989 (+ 48us) client_negotiation.cc:769] Sending connection context
0809 23:23:52.090072 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 23:23:52.090179 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":72,"threads_started":1}
I20260809 23:23:52.090374 27249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.081208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51360 (local address 127.1.235.190:44079)
0809 23:23:52.081348 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.081355 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.081471 (+ 116us) server_negotiation.cc:407] Connection header received
0809 23:23:52.082048 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.082051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.082066 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.082168 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.082707 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.083575 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.084773 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.085226 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.085329 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.087292 (+ 1963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:52.087311 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:52.087312 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:52.087319 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:52.088969 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.089286 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.089289 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.089289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.089381 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.089577 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.089578 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.089578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.089852 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:52.089944 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:52.090134 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 23:23:52.090257 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":106,"thread_start_us":66,"threads_started":1}
I20260809 23:23:52.091014 27245 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.1.235.189@KRBTEST.COM; defaulting to no policy
I20260809 23:23:52.091305 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.091193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:35697 (local address 127.0.0.1:57990)
0809 23:23:52.091248 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.091285 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:35697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 23:23:52.091423 27188 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.235.189:35697: connect: Connection refused (error 111)
I20260809 23:23:52.091790 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.091708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:35697 (local address 127.0.0.1:57996)
0809 23:23:52.091749 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.091771 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:35697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260809 23:23:52.091892 27245 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.189:35697: Network error: Client connection negotiation failed: client connection to 127.1.235.189:35697: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.189.keytab.
Entry for principal kudu/127.1.235.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.189.keytab.
I20260809 23:23:52.107023 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.189:35697
--webserver_interface=127.1.235.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.189.keytab
--principal=kudu/127.1.235.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:33669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:44079,127.1.235.189:35697,127.1.235.188:33501
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:23:52.141204 27245 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } attempt: 1
I20260809 23:23:52.141562 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.141455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:35697 (local address 127.0.0.1:58008)
0809 23:23:52.141510 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.141542 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:35697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 23:23:52.141923 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.141851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:35697 (local address 127.0.0.1:58022)
0809 23:23:52.141879 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.141908 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:35697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260809 23:23:52.142026 27245 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.189:35697: Network error: Client connection negotiation failed: client connection to 127.1.235.189:35697: connect: Connection refused (error 111)
W20260809 23:23:52.181339 27253 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 23:23:52.181520 27253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:52.181537 27253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:52.181555 27253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:52.182576 27253 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:52.182611 27253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:52.182624 27253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:52.182636 27253 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:52.182683 27253 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:52.183972 27253 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:33669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:44079,127.1.235.189:35697,127.1.235.188:33501
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.189.keytab
--principal=kudu/127.1.235.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.189:35697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.1.235.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:52.184190 27253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:52.184393 27253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:52.188941 27259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:52.189030 27260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:52.188942 27262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:52.189258 27253 server_base.cc:1034] running on GCE node
I20260809 23:23:52.189527 27253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:52.189793 27253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:52.190985 27253 hybrid_clock.cc:648] HybridClock initialized: now 1786317832190968 us; error 46 us; skew 500 ppm
Aug 09 23:23:52 dist-test-slave-6nmv krb5kdc[27156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317832, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:52.193356 27253 init.cc:377] Logged in from keytab as kudu/127.1.235.189@KRBTEST.COM (short username kudu)
I20260809 23:23:52.193866 27253 webserver.cc:460] Webserver started at http://127.1.235.189:40365/ using document root <none> and password file <none>
I20260809 23:23:52.194098 27253 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:52.194164 27253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:52.194303 27253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:52.195259 27253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-1/data/instance:
uuid: "cf05fc2e6fd54fc0b772ab78302df0dc"
format_stamp: "Formatted at 2026-08-09 23:23:52 on dist-test-slave-6nmv"
server_key: "1b05496d80695d2c6648681fcbf91e46"
server_key_iv: "835d30ab8de3fdd7a96ef060d20a1d51"
server_key_version: "encryptionkey@0"
I20260809 23:23:52.195621 27253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-1/wal/instance:
uuid: "cf05fc2e6fd54fc0b772ab78302df0dc"
format_stamp: "Formatted at 2026-08-09 23:23:52 on dist-test-slave-6nmv"
server_key: "1b05496d80695d2c6648681fcbf91e46"
server_key_iv: "835d30ab8de3fdd7a96ef060d20a1d51"
server_key_version: "encryptionkey@0"
I20260809 23:23:52.196883 27253 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260809 23:23:52.197567 27270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:52.197737 27253 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:52.197854 27253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-1/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-1/wal
uuid: "cf05fc2e6fd54fc0b772ab78302df0dc"
format_stamp: "Formatted at 2026-08-09 23:23:52 on dist-test-slave-6nmv"
server_key: "1b05496d80695d2c6648681fcbf91e46"
server_key_iv: "835d30ab8de3fdd7a96ef060d20a1d51"
server_key_version: "encryptionkey@0"
I20260809 23:23:52.197947 27253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:52.206180 27253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:52.207866 27253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:52.208040 27253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:52.210170 27245 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } attempt: 2
I20260809 23:23:52.210529 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.210406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:35697 (local address 127.0.0.1:58038)
0809 23:23:52.210462 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.210494 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:35697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 23:23:52.210906 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.210801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:35697 (local address 127.0.0.1:58054)
0809 23:23:52.210858 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.210879 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.189:35697: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 23:23:52.210994 27245 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.189:35697: Network error: Client connection negotiation failed: client connection to 127.1.235.189:35697: connect: Connection refused (error 111)
I20260809 23:23:52.212185 27253 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.189:35697
I20260809 23:23:52.212258 27326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.189:35697 every 8 connection(s)
I20260809 23:23:52.212539 27253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-1/data/info.pb
I20260809 23:23:52.213407 27327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:52.214787 27327 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 23:23:52 dist-test-slave-6nmv krb5kdc[27156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317832, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.189@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:52.220928 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 27253
I20260809 23:23:52.221037 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-1/wal/instance
I20260809 23:23:52.221235 1966 external_mini_cluster.cc:1428] Setting key 312f6347aa4377064c624235e1d3346c
I20260809 23:23:52.222782 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.215309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44079 (local address 127.0.0.1:51368)
0809 23:23:52.215470 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.215499 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:52.215891 (+ 392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:52.216106 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:52.216109 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:52.216325 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:52.216507 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.216511 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.217124 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.217125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.217981 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.217983 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.218294 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.218295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.218388 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.218795 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:52.218802 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:52.220072 (+ 1270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:52.221601 (+ 1529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.221607 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.221608 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.221800 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.222025 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.222025 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.222026 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.222129 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.222391 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:52.222395 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:52.222488 (+ 93us) client_negotiation.cc:769] Sending connection context
0809 23:23:52.222559 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 23:23:52.222657 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
I20260809 23:23:52.222805 27249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.215347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51368 (local address 127.1.235.190:44079)
0809 23:23:52.215428 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.215430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.215567 (+ 137us) server_negotiation.cc:407] Connection header received
0809 23:23:52.215966 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.215967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.215977 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.216046 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.216583 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.217046 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.218046 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.218217 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.218267 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.220146 (+ 1879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:52.220147 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:52.220147 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:52.220153 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:52.221520 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.221904 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.221905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.221905 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.221968 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.222185 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.222186 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.222187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.222332 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:52.222396 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:52.222598 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 23:23:52.222679 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 23:23:52.223424 27327 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 23:23:52 dist-test-slave-6nmv krb5kdc[27156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317832, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.189@KRBTEST.COM for kudu/127.1.235.189@KRBTEST.COM
WARNING: no policy specified for kudu/127.1.235.188@KRBTEST.COM; defaulting to no policy
I20260809 23:23:52.231104 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.224172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:35697 (local address 127.0.0.1:58058)
0809 23:23:52.224223 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.224233 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:52.224268 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:52.224539 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:52.224540 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:52.224647 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:52.224687 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.224688 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.225953 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.225954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.226438 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.226439 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.227114 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.227115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.227175 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.227571 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:52.227575 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:52.228731 (+ 1156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:52.230306 (+ 1575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.230306 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.230306 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.230458 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.230648 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.230649 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.230649 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.230711 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.230911 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:52.230911 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:52.230949 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 23:23:52.230991 (+ 42us) client_negotiation.cc:240] Negotiation successful
0809 23:23:52.231056 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 23:23:52.231243 27331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.224246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58058 (local address 127.1.235.189:35697)
0809 23:23:52.224387 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.224392 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.224419 (+ 27us) server_negotiation.cc:407] Connection header received
0809 23:23:52.224440 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.224442 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.224455 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.224529 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.224752 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.225864 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.226521 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.227034 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.227118 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.228814 (+ 1696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:52.228822 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:52.228822 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:52.228828 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:52.230242 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.230529 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.230532 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.230532 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.230587 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.230764 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.230764 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.230765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.230862 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:52.230913 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:52.231010 (+ 97us) server_negotiation.cc:299] Negotiation successful
0809 23:23:52.231102 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":113,"thread_start_us":73,"threads_started":1}
I20260809 23:23:52.231873 27327 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:23:52.232149 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.232065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:33501 (local address 127.0.0.1:47596)
0809 23:23:52.232093 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.232131 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:33501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260809 23:23:52.232275 27274 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.235.188:33501: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.1.235.188@KRBTEST.COM" created.
I20260809 23:23:52.232698 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.232593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:33501 (local address 127.0.0.1:47600)
0809 23:23:52.232635 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.232682 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:33501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260809 23:23:52.232903 27327 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.188:33501: Network error: Client connection negotiation failed: client connection to 127.1.235.188:33501: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.1.235.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.188.keytab.
Entry for principal kudu/127.1.235.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.188.keytab.
I20260809 23:23:52.244658 1966 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskGyHluD/build/release/bin/kudu
/tmp/dist-test-taskGyHluD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.188:33501
--webserver_interface=127.1.235.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.188.keytab
--principal=kudu/127.1.235.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.1.235.148:33669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.1.235.190:44079,127.1.235.189:35697,127.1.235.188:33501
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 23:23:52.282119 27327 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } attempt: 1
I20260809 23:23:52.282500 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.282384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:33501 (local address 127.0.0.1:47606)
0809 23:23:52.282441 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.282475 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:33501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 23:23:52.282806 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.282712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:33501 (local address 127.0.0.1:47622)
0809 23:23:52.282751 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.282772 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:33501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 23:23:52.282882 27327 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.188:33501: Network error: Client connection negotiation failed: client connection to 127.1.235.188:33501: connect: Connection refused (error 111)
I20260809 23:23:52.302114 27245 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } attempt: 3
Aug 09 23:23:52 dist-test-slave-6nmv krb5kdc[27156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317832, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for kudu/127.1.235.189@KRBTEST.COM
I20260809 23:23:52.308576 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.302362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:35697 (local address 127.0.0.1:58070)
0809 23:23:52.302416 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.302446 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:52.302500 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:52.302639 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:52.302640 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:52.302787 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:52.302848 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.302850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.303475 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.303476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.303964 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.303966 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.304326 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.304327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.304404 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.304834 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:52.304837 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:52.306123 (+ 1286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:52.307629 (+ 1506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.307630 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.307631 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.307783 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.307995 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.307995 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.307996 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.308050 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.308278 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:52.308279 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:52.308319 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 23:23:52.308397 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 23:23:52.308488 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 23:23:52.308575 27331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.302462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58070 (local address 127.1.235.189:35697)
0809 23:23:52.302521 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.302524 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.302533 (+ 9us) server_negotiation.cc:407] Connection header received
0809 23:23:52.302557 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.302558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.302570 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.302632 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.302940 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.303382 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.304047 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.304259 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.304328 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.306211 (+ 1883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:52.306212 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:52.306213 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:52.306221 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:52.307550 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.307860 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.307862 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.307862 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.307930 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.308110 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.308111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.308111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.308211 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:52.308286 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:52.308429 (+ 143us) server_negotiation.cc:299] Negotiation successful
0809 23:23:52.308501 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 23:23:52.308911 27245 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:23:52.309267 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.309167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:33501 (local address 127.0.0.1:47630)
0809 23:23:52.309214 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.309250 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:33501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 23:23:52.309540 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.309463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:33501 (local address 127.0.0.1:47634)
0809 23:23:52.309501 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.309521 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:33501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260809 23:23:52.309624 27245 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.188:33501: Network error: Client connection negotiation failed: client connection to 127.1.235.188:33501: connect: Connection refused (error 111)
W20260809 23:23:52.318367 27334 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 23:23:52.318549 27334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 23:23:52.318581 27334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 23:23:52.318636 27334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 23:23:52.319734 27334 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 23:23:52.319794 27334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 23:23:52.319818 27334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 23:23:52.319842 27334 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 23:23:52.319869 27334 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 23:23:52.321234 27334 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.1.235.148:33669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.1.235.190:44079,127.1.235.189:35697,127.1.235.188:33501
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/krb5kdc/kudu_127.1.235.188.keytab
--principal=kudu/127.1.235.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.1.235.188:33501
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.1.235.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 09 Aug 2026 22:16:40 UTC on ccycloud.quasar-nungeg.root.comops.site
build id 4576814
I20260809 23:23:52.321476 27334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 23:23:52.321684 27334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 23:23:52.325759 27342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:52.325798 27340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 23:23:52.325778 27339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 23:23:52.326059 27334 server_base.cc:1034] running on GCE node
I20260809 23:23:52.326277 27334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 23:23:52.326538 27334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 23:23:52.327679 27334 hybrid_clock.cc:648] HybridClock initialized: now 1786317832327657 us; error 35 us; skew 500 ppm
Aug 09 23:23:52 dist-test-slave-6nmv krb5kdc[27156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317832, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 23:23:52.329731 27334 init.cc:377] Logged in from keytab as kudu/127.1.235.188@KRBTEST.COM (short username kudu)
I20260809 23:23:52.330194 27334 webserver.cc:460] Webserver started at http://127.1.235.188:34885/ using document root <none> and password file <none>
I20260809 23:23:52.330402 27334 fs_manager.cc:359] Metadata directory not provided
I20260809 23:23:52.330461 27334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 23:23:52.330577 27334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 23:23:52.331761 27334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-2/data/instance:
uuid: "765f0afffb6f4dad87af4ff3efc35b0d"
format_stamp: "Formatted at 2026-08-09 23:23:52 on dist-test-slave-6nmv"
server_key: "5ad1984d065e8d2c4bb6ae57387445e5"
server_key_iv: "52bd1aade5777b6da6a85c9a0accb1fa"
server_key_version: "encryptionkey@0"
I20260809 23:23:52.332156 27334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-2/wal/instance:
uuid: "765f0afffb6f4dad87af4ff3efc35b0d"
format_stamp: "Formatted at 2026-08-09 23:23:52 on dist-test-slave-6nmv"
server_key: "5ad1984d065e8d2c4bb6ae57387445e5"
server_key_iv: "52bd1aade5777b6da6a85c9a0accb1fa"
server_key_version: "encryptionkey@0"
I20260809 23:23:52.333863 27334 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260809 23:23:52.334718 27349 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 23:23:52.334867 27334 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260809 23:23:52.334944 27334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-2/data,/tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-2/wal
uuid: "765f0afffb6f4dad87af4ff3efc35b0d"
format_stamp: "Formatted at 2026-08-09 23:23:52 on dist-test-slave-6nmv"
server_key: "5ad1984d065e8d2c4bb6ae57387445e5"
server_key_iv: "52bd1aade5777b6da6a85c9a0accb1fa"
server_key_version: "encryptionkey@0"
I20260809 23:23:52.335004 27334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 23:23:52.340749 27245 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } attempt: 1
I20260809 23:23:52.341128 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.340984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:33501 (local address 127.0.0.1:47646)
0809 23:23:52.341039 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.341065 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:33501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 23:23:52.341418 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.341327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:33501 (local address 127.0.0.1:47648)
0809 23:23:52.341375 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.341398 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:33501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260809 23:23:52.341511 27245 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.188:33501: Network error: Client connection negotiation failed: client connection to 127.1.235.188:33501: connect: Connection refused (error 111)
I20260809 23:23:52.347604 27334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 23:23:52.349216 27334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 23:23:52.349345 27334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 23:23:52.351024 27327 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } attempt: 2
I20260809 23:23:52.351418 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.351290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:33501 (local address 127.0.0.1:47658)
0809 23:23:52.351337 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.351381 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:33501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260809 23:23:52.351832 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.351705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:33501 (local address 127.0.0.1:47670)
0809 23:23:52.351761 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.351795 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.1.235.188:33501: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 23:23:52.351936 27327 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.1.235.188:33501: Network error: Client connection negotiation failed: client connection to 127.1.235.188:33501: connect: Connection refused (error 111)
I20260809 23:23:52.353470 27334 rpc_server.cc:307] RPC server started. Bound to: 127.1.235.188:33501
I20260809 23:23:52.353518 27407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.1.235.188:33501 every 8 connection(s)
I20260809 23:23:52.353910 27334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-2/data/info.pb
I20260809 23:23:52.354799 27408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 23:23:52.356190 27408 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:23:52.358712 1966 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskGyHluD/build/release/bin/kudu as pid 27334
I20260809 23:23:52.358835 1966 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskGyHluD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786317539151495-1966-0/minicluster-data/master-2/wal/instance
I20260809 23:23:52.359040 1966 external_mini_cluster.cc:1428] Setting key 70fbb2672c74a706619c847d125e6fcf
Aug 09 23:23:52 dist-test-slave-6nmv krb5kdc[27156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317832, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.188@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
Aug 09 23:23:52 dist-test-slave-6nmv krb5kdc[27156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.188@KRBTEST.COM
I20260809 23:23:52.365211 27249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.356786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51380 (local address 127.1.235.190:44079)
0809 23:23:52.356825 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.356827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.357039 (+ 212us) server_negotiation.cc:407] Connection header received
0809 23:23:52.357490 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.357491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.357500 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.357552 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.358163 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.358629 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.359934 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.360144 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.360219 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.362167 (+ 1948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:52.362169 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:52.362169 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:52.362177 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:52.363836 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.364217 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.364219 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.364220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.364275 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.364545 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.364546 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.364546 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.364680 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:52.364745 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:52.365045 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 23:23:52.365113 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260809 23:23:52.365330 27410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.356760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.190:44079 (local address 127.0.0.1:51380)
0809 23:23:52.356918 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.356955 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:52.357412 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:52.357597 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:52.357600 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:52.357896 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:52.358091 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.358095 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.358738 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.358739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.359860 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.359861 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.360237 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.360238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.360372 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.360830 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:52.360837 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:52.362081 (+ 1244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:52.363907 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.363914 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.363916 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.364143 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.364340 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.364340 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.364341 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.364479 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.364756 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:52.364764 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:52.364907 (+ 143us) client_negotiation.cc:769] Sending connection context
0809 23:23:52.365020 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 23:23:52.365154 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":84,"threads_started":1}
I20260809 23:23:52.365897 27408 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:23:52.367429 27412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.359401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47672 (local address 127.1.235.188:33501)
0809 23:23:52.359540 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.359544 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.359611 (+ 67us) server_negotiation.cc:407] Connection header received
0809 23:23:52.359637 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.359639 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.359656 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.359734 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.360273 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.361072 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.361758 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.362071 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.362143 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.364417 (+ 2274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:52.364421 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:52.364422 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:52.364427 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:52.366293 (+ 1866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.366715 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.366718 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.366718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.366781 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.366949 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.366950 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.366950 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.367106 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:52.367240 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:52.367286 (+ 46us) server_negotiation.cc:299] Negotiation successful
0809 23:23:52.367348 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":85,"threads_started":1}
Aug 09 23:23:52 dist-test-slave-6nmv krb5kdc[27156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317832, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.188@KRBTEST.COM for kudu/127.1.235.189@KRBTEST.COM
Aug 09 23:23:52 dist-test-slave-6nmv krb5kdc[27156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.190@KRBTEST.COM
I20260809 23:23:52.373062 27331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.366225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58076 (local address 127.1.235.189:35697)
0809 23:23:52.366268 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.366270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.366307 (+ 37us) server_negotiation.cc:407] Connection header received
0809 23:23:52.366386 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.366387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.366397 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.366455 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.366733 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.367433 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.368329 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.368646 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.368717 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.370438 (+ 1721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:52.370440 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:52.370440 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:52.370447 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:52.371962 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.372272 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.372273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.372273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.372331 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.372558 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.372559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.372559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.372699 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:52.372787 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:52.372944 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 23:23:52.373008 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:23:52.373083 27410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.366145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.189:35697 (local address 127.0.0.1:58076)
0809 23:23:52.366258 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.366268 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:52.366313 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:52.366461 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:52.366461 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:52.366600 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:52.366661 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.366663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.367670 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.367671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.368257 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.368259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.368729 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.368730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.368789 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.369103 (+ 314us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:52.369107 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:52.370358 (+ 1251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:52.372044 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.372045 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.372045 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.372200 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.372398 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.372399 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.372399 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.372481 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.372782 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:52.372783 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:52.372814 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 23:23:52.372899 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 23:23:52.372979 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260809 23:23:52.373521 27408 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } has no permanent_uuid. Determining permanent_uuid...
I20260809 23:23:52.375700 27249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.368123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51382 (local address 127.1.235.190:44079)
0809 23:23:52.368157 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.368159 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.368166 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:23:52.368183 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.368183 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.368191 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.368251 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.368743 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.369373 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.370259 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.370412 (+ 153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.370485 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.372899 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:52.372900 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:52.372900 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:52.372907 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:52.374761 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.375073 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.375074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.375074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.375126 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.375299 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.375299 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.375300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.375381 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:52.375488 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:52.375578 (+ 90us) server_negotiation.cc:299] Negotiation successful
0809 23:23:52.375631 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Aug 09 23:23:52 dist-test-slave-6nmv krb5kdc[27156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317832, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.188@KRBTEST.COM for kudu/127.1.235.188@KRBTEST.COM
I20260809 23:23:52.380111 27410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.373771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:33501 (local address 127.0.0.1:47684)
0809 23:23:52.373844 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.373854 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:52.373896 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:52.374021 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:52.374022 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:52.374149 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:52.374170 (+ 21us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.374171 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.374730 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.374731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.375392 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.375394 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.375837 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.375838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.375874 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.376292 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:52.376298 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:52.377668 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:52.379235 (+ 1567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.379236 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.379236 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.379386 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.379578 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.379579 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.379580 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.379628 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.379847 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:52.379848 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:52.379881 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 23:23:52.379943 (+ 62us) client_negotiation.cc:240] Negotiation successful
0809 23:23:52.380023 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 23:23:52.380200 27412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.373855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47684 (local address 127.1.235.188:33501)
0809 23:23:52.373886 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.373887 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.373895 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:23:52.373957 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.373958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.373967 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.374018 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.374240 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.374659 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.375477 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.375736 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.375795 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.377770 (+ 1975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:52.377771 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:52.377771 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:52.377780 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:52.379161 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.379466 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.379467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.379468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.379512 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.379692 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.379692 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.379693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.379787 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:52.379854 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:52.380000 (+ 146us) server_negotiation.cc:299] Negotiation successful
0809 23:23:52.380067 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":7,"server-negotiator.queue_time_us":16}
Aug 09 23:23:52 dist-test-slave-6nmv krb5kdc[27156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.1.235.189@KRBTEST.COM
I20260809 23:23:52.381803 27408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d: Bootstrap starting.
I20260809 23:23:52.382743 27408 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:52.383061 27408 log.cc:824] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:52.383322 27331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.376316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58080 (local address 127.1.235.189:35697)
0809 23:23:52.376349 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.376350 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.376358 (+ 8us) server_negotiation.cc:407] Connection header received
0809 23:23:52.376418 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.376419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.376425 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.376467 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.377016 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.377655 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.378498 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.378781 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.378850 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.380909 (+ 2059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:52.380910 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:52.380910 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:52.380915 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:52.382237 (+ 1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.382603 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.382604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.382604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.382647 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.382849 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.382850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.382850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.382954 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:52.383048 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:52.383165 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 23:23:52.383235 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260809 23:23:52.383956 27408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d: No bootstrap required, opened a new log
I20260809 23:23:52.384472 1966 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 23:23:52.385692 27408 raft_consensus.cc:348] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } }
I20260809 23:23:52.385823 27408 raft_consensus.cc:729] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765f0afffb6f4dad87af4ff3efc35b0d, State: Initialized, Role: FOLLOWER
I20260809 23:23:52.385946 27408 consensus_queue.cc:260] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } }
I20260809 23:23:52.386288 27408 sys_catalog.cc:564] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:52.386265 27414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } } }
I20260809 23:23:52.386348 27414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 23:23:52.385553 27214 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c00ac86c51ca47e2896462451a20fda2"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51382
W20260809 23:23:52.388053 27426 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 23:23:52.388104 27426 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:23:52.388389 27334 master_runner.cc:186] Error getting master registration for 127.1.235.190:44079: OK, instance_id { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" instance_seqno: 1786317832076675 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 23:23:52.390386 27334 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 23:23:52.416663 27245 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } attempt: 2
Aug 09 23:23:52 dist-test-slave-6nmv krb5kdc[27156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317832, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.190@KRBTEST.COM for kudu/127.1.235.188@KRBTEST.COM
I20260809 23:23:52.424069 27248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.416970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:33501 (local address 127.0.0.1:47690)
0809 23:23:52.417032 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.417045 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:52.417107 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:52.417269 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:52.417269 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:52.417456 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:52.417506 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.417508 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.418412 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.418412 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.419177 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.419179 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.419635 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.419636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.419685 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.420138 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:52.420142 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:52.421361 (+ 1219us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:52.423090 (+ 1729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.423091 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.423091 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.423252 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.423442 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.423443 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.423444 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.423499 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.423763 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:52.423763 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:52.423806 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 23:23:52.423889 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 23:23:52.423983 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260809 23:23:52.424069 27412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.417045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47690 (local address 127.1.235.188:33501)
0809 23:23:52.417116 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.417118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.417131 (+ 13us) server_negotiation.cc:407] Connection header received
0809 23:23:52.417176 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.417177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.417188 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.417252 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.417583 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.418328 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.419260 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.419552 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.419645 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.421456 (+ 1811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:52.421458 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:52.421458 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:52.421465 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:52.423011 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.423320 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.423321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.423321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.423373 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.423567 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.423567 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.423568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.423699 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:52.423769 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:52.423910 (+ 141us) server_negotiation.cc:299] Negotiation successful
0809 23:23:52.423983 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 23:23:52.425570 27245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2: Bootstrap starting.
I20260809 23:23:52.426249 27245 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:52.426481 27245 log.cc:824] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:52.427328 27245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2: No bootstrap required, opened a new log
I20260809 23:23:52.428699 27245 raft_consensus.cc:348] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } }
I20260809 23:23:52.428829 27245 raft_consensus.cc:729] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00ac86c51ca47e2896462451a20fda2, State: Initialized, Role: FOLLOWER
I20260809 23:23:52.428895 27245 consensus_queue.cc:260] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } }
I20260809 23:23:52.429206 27245 sys_catalog.cc:564] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:52.429301 27214 raft_consensus.cc:482] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 23:23:52.429360 27214 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:52.430223 27214 raft_consensus.cc:504] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } }
I20260809 23:23:52.430843 27379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c00ac86c51ca47e2896462451a20fda2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "765f0afffb6f4dad87af4ff3efc35b0d"
I20260809 23:23:52.430974 27379 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d [term 0 FOLLOWER]: Advancing to term 1
W20260809 23:23:52.431280 27440 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 23:23:52.431326 27440 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:23:52.431474 27429 sys_catalog.cc:455] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } } }
I20260809 23:23:52.431540 27429 sys_catalog.cc:458] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 23:23:52.431960 27379 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00ac86c51ca47e2896462451a20fda2 in term 1.
I20260809 23:23:52.432387 27189 leader_election.cc:302] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765f0afffb6f4dad87af4ff3efc35b0d, c00ac86c51ca47e2896462451a20fda2; no voters:
I20260809 23:23:52.432586 27429 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 23:23:52.432667 27214 leader_election.cc:288] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [CANDIDATE]: Term 1 election: Requested vote from peers cf05fc2e6fd54fc0b772ab78302df0dc (127.1.235.189:35697), 765f0afffb6f4dad87af4ff3efc35b0d (127.1.235.188:33501)
I20260809 23:23:52.432838 27429 raft_consensus.cc:686] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [term 1 LEADER]: Becoming Leader. State: Replica: c00ac86c51ca47e2896462451a20fda2, State: Running, Role: LEADER
I20260809 23:23:52.432981 27429 consensus_queue.cc:237] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } }
I20260809 23:23:52.433559 27169 master_runner.cc:186] Error getting master registration for 127.1.235.189:35697: OK, instance_id { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" instance_seqno: 1786317832211069 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 23:23:52.435304 27169 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 23:23:52.435612 27442 sys_catalog.cc:455] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c00ac86c51ca47e2896462451a20fda2. Latest consensus state: current_term: 1 leader_uuid: "c00ac86c51ca47e2896462451a20fda2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } } }
I20260809 23:23:52.435699 27442 sys_catalog.cc:458] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:52.435910 27448 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 23:23:52.436088 27448 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 23:23:52.437775 27379 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d [term 1 FOLLOWER]: Refusing update from remote peer c00ac86c51ca47e2896462451a20fda2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:23:52.438133 27442 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 23:23:52.439291 27414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c00ac86c51ca47e2896462451a20fda2. Latest consensus state: current_term: 1 leader_uuid: "c00ac86c51ca47e2896462451a20fda2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } } }
I20260809 23:23:52.439396 27414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 23:23:52.443073 27327 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } attempt: 3
I20260809 23:23:52.446704 27442 sys_catalog.cc:455] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c00ac86c51ca47e2896462451a20fda2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } } }
I20260809 23:23:52.446789 27442 sys_catalog.cc:458] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:52.447191 27414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c00ac86c51ca47e2896462451a20fda2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } } }
I20260809 23:23:52.447300 27414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d [sys.catalog]: This master's current role is: FOLLOWER
Aug 09 23:23:52 dist-test-slave-6nmv krb5kdc[27156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786317832, etypes {rep=17 tkt=17 ses=17}, kudu/127.1.235.189@KRBTEST.COM for kudu/127.1.235.188@KRBTEST.COM
I20260809 23:23:52.450240 27451 mvcc.cc:205] Tried to move back new op lower bound from 7316757841662812160 to 7316757841649016832. Current Snapshot: MvccSnapshot[applied={T|T < 7316757841662812160}]
I20260809 23:23:52.455446 27331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.437191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58092 (local address 127.1.235.189:35697)
0809 23:23:52.437228 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.437230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.439761 (+ 2531us) server_negotiation.cc:407] Connection header received
0809 23:23:52.439992 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.439993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.440003 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.440029 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.442134 (+ 2105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.442786 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.446008 (+ 3222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.446329 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.446371 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.450837 (+ 4466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:52.450839 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:52.450839 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:52.450846 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:52.453988 (+ 3142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.454399 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.454412 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.454412 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.454468 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.454679 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.454679 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.454680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.454828 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:52.454907 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:52.455210 (+ 303us) server_negotiation.cc:299] Negotiation successful
0809 23:23:52.455298 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260809 23:23:52.455677 27329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.443311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.1.235.188:33501 (local address 127.0.0.1:47706)
0809 23:23:52.443356 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0809 23:23:52.443364 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0809 23:23:52.443396 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 23:23:52.443691 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 23:23:52.443692 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 23:23:52.443863 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0809 23:23:52.443910 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.443913 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.445152 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.445153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.445873 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 23:23:52.445875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.446675 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.446676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 23:23:52.446748 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.448205 (+ 1457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 23:23:52.448211 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0809 23:23:52.449957 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 23:23:52.454109 (+ 4152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.454110 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.454110 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.454315 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.454680 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 23:23:52.454680 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 23:23:52.454681 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0809 23:23:52.454962 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 23:23:52.455382 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 23:23:52.455383 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 23:23:52.455448 (+ 65us) client_negotiation.cc:769] Sending connection context
0809 23:23:52.455497 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 23:23:52.455595 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260809 23:23:52.456847 27455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.443354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47706 (local address 127.1.235.188:33501)
0809 23:23:52.443483 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.443485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.443517 (+ 32us) server_negotiation.cc:407] Connection header received
0809 23:23:52.443535 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.443536 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.443545 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.443994 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.444051 (+ 57us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.445037 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.446039 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.446529 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.450495 (+ 3966us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.450589 (+ 94us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:52.450624 (+ 35us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:52.450624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:52.450630 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:52.453995 (+ 3365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.454453 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.454454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.454454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.454546 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.455019 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.455020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.455020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.455273 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:52.456356 (+ 1083us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:52.456443 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 23:23:52.456639 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":67,"threads_started":1}
I20260809 23:23:52.457345 27448 catalog_manager.cc:1347] Generated new cluster ID: 7a284a27e7884fc0ad44cc8e57973ac7
I20260809 23:23:52.457401 27448 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 23:23:52.458839 27327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc: Bootstrap starting.
I20260809 23:23:52.459569 27327 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc: Neither blocks nor log segments found. Creating new log.
I20260809 23:23:52.459892 27327 log.cc:824] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc: Log is configured to *not* fsync() on all Append() calls
I20260809 23:23:52.460008 27249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.436960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51398 (local address 127.1.235.190:44079)
0809 23:23:52.436998 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.437000 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.440146 (+ 3146us) server_negotiation.cc:407] Connection header received
0809 23:23:52.441203 (+ 1057us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.441204 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.441214 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.441258 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.442107 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.442782 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.446733 (+ 3951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.447020 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.447062 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.450662 (+ 3600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:52.450664 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:52.450664 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:52.450671 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:52.453631 (+ 2960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.458520 (+ 4889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.458522 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.458522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.458581 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.459040 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.459041 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.459042 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.459170 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:52.459259 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:52.459855 (+ 596us) server_negotiation.cc:299] Negotiation successful
0809 23:23:52.459940 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260809 23:23:52.460870 27412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:52.437399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47704 (local address 127.1.235.188:33501)
0809 23:23:52.437441 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.437443 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.439673 (+ 2230us) server_negotiation.cc:407] Connection header received
0809 23:23:52.439893 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.439894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.439904 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.439931 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.443713 (+ 3782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.444316 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.447576 (+ 3260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:52.447845 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:52.447890 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:52.456470 (+ 8580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 23:23:52.456471 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 23:23:52.456472 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 23:23:52.456479 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0809 23:23:52.458126 (+ 1647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.458785 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.458786 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.458787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.458847 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 23:23:52.459447 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 23:23:52.459448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 23:23:52.459448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0809 23:23:52.459566 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 23:23:52.459636 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:52.460693 (+ 1057us) server_negotiation.cc:299] Negotiation successful
0809 23:23:52.460766 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260809 23:23:52.461457 27327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc: No bootstrap required, opened a new log
I20260809 23:23:52.463075 27327 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } }
I20260809 23:23:52.463161 27327 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf05fc2e6fd54fc0b772ab78302df0dc, State: Initialized, Role: FOLLOWER
I20260809 23:23:52.463205 27327 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } }
I20260809 23:23:52.463487 27327 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 23:23:52.463447 27459 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } } }
I20260809 23:23:52.463536 27459 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 23:23:52.464852 27300 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c00ac86c51ca47e2896462451a20fda2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc"
I20260809 23:23:52.464772 27299 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc [term 0 FOLLOWER]: Advancing to term 1
I20260809 23:23:52.466238 27299 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc [term 1 FOLLOWER]: Refusing update from remote peer c00ac86c51ca47e2896462451a20fda2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 23:23:52.466944 27300 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00ac86c51ca47e2896462451a20fda2 in term 1.
I20260809 23:23:52.467482 27429 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 23:23:52.468411 27471 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 23:23:52.468528 27471 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 23:23:52.470691 27459 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader c00ac86c51ca47e2896462451a20fda2. Latest consensus state: current_term: 1 leader_uuid: "c00ac86c51ca47e2896462451a20fda2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } } }
I20260809 23:23:52.470777 27459 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 23:23:52.470820 27459 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c00ac86c51ca47e2896462451a20fda2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } } }
I20260809 23:23:52.470871 27459 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc [sys.catalog]: This master's current role is: FOLLOWER
I20260809 23:23:52.475694 27473 mvcc.cc:205] Tried to move back new op lower bound from 7316757841662812160 to 7316757841649016832. Current Snapshot: MvccSnapshot[applied={T|T < 7316757841662812160}]
I20260809 23:23:52.491917 27429 sys_catalog.cc:455] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c00ac86c51ca47e2896462451a20fda2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c00ac86c51ca47e2896462451a20fda2" member_type: VOTER last_known_addr { host: "127.1.235.190" port: 44079 } } peers { permanent_uuid: "cf05fc2e6fd54fc0b772ab78302df0dc" member_type: VOTER last_known_addr { host: "127.1.235.189" port: 35697 } } peers { permanent_uuid: "765f0afffb6f4dad87af4ff3efc35b0d" member_type: VOTER last_known_addr { host: "127.1.235.188" port: 33501 } } }
I20260809 23:23:52.492038 27429 sys_catalog.cc:458] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2 [sys.catalog]: This master's current role is: LEADER
I20260809 23:23:52.493882 27448 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 23:23:52.494544 27448 catalog_manager.cc:1504] Loading token signing keys...
I20260809 23:23:52.499275 27448 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c00ac86c51ca47e2896462451a20fda2: Generated new TSK 0
I20260809 23:23:52.499466 27448 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 23:23:52.532761 27249 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:52.530997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51406 (local address 127.1.235.190:44079)
0809 23:23:52.531037 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.531039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.531920 (+ 881us) server_negotiation.cc:407] Connection header received
0809 23:23:52.532028 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.532029 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.532040 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.532069 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.532695 (+ 626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51406: BlockingRecv error: recv got EOF from 127.0.0.1:51406 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260809 23:23:52.533692 27331 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:52.531192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58100 (local address 127.1.235.189:35697)
0809 23:23:52.531235 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.531237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.533259 (+ 2022us) server_negotiation.cc:407] Connection header received
0809 23:23:52.533341 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.533342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.533351 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.533376 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.533637 (+ 261us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58100: BlockingRecv error: recv got EOF from 127.0.0.1:58100 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260809 23:23:52.534458 27412 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:52.531372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47708 (local address 127.1.235.188:33501)
0809 23:23:52.531405 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.531407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.534038 (+ 2631us) server_negotiation.cc:407] Connection header received
0809 23:23:52.534126 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.534127 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.534136 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.534160 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.534407 (+ 247us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47708: BlockingRecv error: recv got EOF from 127.0.0.1:47708 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260809 23:23:52.536701 27331 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:52.535976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58108 (local address 127.1.235.189:35697)
0809 23:23:52.536027 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.536028 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.536231 (+ 203us) server_negotiation.cc:407] Connection header received
0809 23:23:52.536329 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.536330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.536344 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.536371 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.536661 (+ 290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58108: BlockingRecv error: recv got EOF from 127.0.0.1:58108 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
W20260809 23:23:52.539660 27331 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:52.538957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58114 (local address 127.1.235.189:35697)
0809 23:23:52.538998 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.538999 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.539238 (+ 239us) server_negotiation.cc:407] Connection header received
0809 23:23:52.539321 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.539322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.539330 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.539354 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.539623 (+ 269us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58114: BlockingRecv error: recv got EOF from 127.0.0.1:58114 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260809 23:23:52.543458 27331 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:52.542779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58120 (local address 127.1.235.189:35697)
0809 23:23:52.542806 (+ 27us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.542808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.543029 (+ 221us) server_negotiation.cc:407] Connection header received
0809 23:23:52.543125 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.543126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.543133 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.543157 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.543427 (+ 270us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58120: BlockingRecv error: recv got EOF from 127.0.0.1:58120 (error 108)
Metrics: {"server-negotiator.queue_time_us":14}
W20260809 23:23:52.549249 27331 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:52.548545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58130 (local address 127.1.235.189:35697)
0809 23:23:52.548574 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.548576 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.548799 (+ 223us) server_negotiation.cc:407] Connection header received
0809 23:23:52.548830 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.548831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.548841 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.548910 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.549212 (+ 302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58130: BlockingRecv error: recv got EOF from 127.0.0.1:58130 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260809 23:23:52.558836 27331 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:52.558173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58144 (local address 127.1.235.189:35697)
0809 23:23:52.558211 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.558212 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.558347 (+ 135us) server_negotiation.cc:407] Connection header received
0809 23:23:52.558398 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.558399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.558409 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.558473 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.558800 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58144: BlockingRecv error: recv got EOF from 127.0.0.1:58144 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260809 23:23:52.576534 27331 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:52.575761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58156 (local address 127.1.235.189:35697)
0809 23:23:52.575801 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.575803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.575953 (+ 150us) server_negotiation.cc:407] Connection header received
0809 23:23:52.576025 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.576026 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.576039 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.576104 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.576478 (+ 374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58156: BlockingRecv error: recv got EOF from 127.0.0.1:58156 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260809 23:23:52.611699 27331 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:52.610845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58166 (local address 127.1.235.189:35697)
0809 23:23:52.610888 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.610890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.611000 (+ 110us) server_negotiation.cc:407] Connection header received
0809 23:23:52.611072 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.611073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.611084 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.611136 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.611596 (+ 460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58166: BlockingRecv error: recv got EOF from 127.0.0.1:58166 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260809 23:23:52.677613 27331 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:52.676859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58174 (local address 127.1.235.189:35697)
0809 23:23:52.676935 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.676937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.677034 (+ 97us) server_negotiation.cc:407] Connection header received
0809 23:23:52.677144 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.677145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.677156 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.677236 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.677549 (+ 313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58174: BlockingRecv error: recv got EOF from 127.0.0.1:58174 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260809 23:23:52.807610 27331 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:52.806799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58184 (local address 127.1.235.189:35697)
0809 23:23:52.806888 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:52.806890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:52.807005 (+ 115us) server_negotiation.cc:407] Connection header received
0809 23:23:52.807106 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:52.807108 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:52.807120 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:52.807194 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:52.807543 (+ 349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58184: BlockingRecv error: recv got EOF from 127.0.0.1:58184 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260809 23:23:53.065595 27331 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 23:23:53.064817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58194 (local address 127.1.235.189:35697)
0809 23:23:53.064896 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:53.064898 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:53.064909 (+ 11us) server_negotiation.cc:407] Connection header received
0809 23:23:53.065013 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:53.065014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:53.065027 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:53.065101 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 23:23:53.065523 (+ 422us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58194: BlockingRecv error: recv got EOF from 127.0.0.1:58194 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 23:23:53.388532 27426 catalog_manager.cc:1259] Loaded cluster ID: 7a284a27e7884fc0ad44cc8e57973ac7
I20260809 23:23:53.388602 27426 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d: loading cluster ID for follower catalog manager: success
I20260809 23:23:53.389362 27426 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d: acquiring CA information for follower catalog manager: success
I20260809 23:23:53.389616 27426 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 765f0afffb6f4dad87af4ff3efc35b0d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 23:23:53.469002 27471 catalog_manager.cc:1259] Loaded cluster ID: 7a284a27e7884fc0ad44cc8e57973ac7
I20260809 23:23:53.469076 27471 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc: loading cluster ID for follower catalog manager: success
I20260809 23:23:53.469744 27471 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc: acquiring CA information for follower catalog manager: success
I20260809 23:23:53.470041 27471 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cf05fc2e6fd54fc0b772ab78302df0dc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 23:23:53.581059 27549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:53.578721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58202 (local address 127.1.235.189:35697)
0809 23:23:53.578860 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:53.578862 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:53.578872 (+ 10us) server_negotiation.cc:407] Connection header received
0809 23:23:53.578952 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:53.578953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:53.579003 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:53.579065 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:23:53.579216 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:53.579665 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:53.580336 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:53.580530 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:53.580576 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:53.580711 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:23:53.580821 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:23:53.580872 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:53.580904 (+ 32us) server_negotiation.cc:299] Negotiation successful
0809 23:23:53.580926 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":74,"threads_started":1}
I20260809 23:23:53.584937 27555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:53.583042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47720 (local address 127.1.235.188:33501)
0809 23:23:53.583177 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:53.583179 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:53.583186 (+ 7us) server_negotiation.cc:407] Connection header received
0809 23:23:53.583226 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:53.583226 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:53.583257 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:53.583321 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:23:53.583381 (+ 60us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:53.583794 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:53.584385 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:53.584568 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:53.584610 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:53.584718 (+ 108us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:23:53.584789 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:23:53.584833 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:53.584861 (+ 28us) server_negotiation.cc:299] Negotiation successful
0809 23:23:53.584874 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":94,"threads_started":1}
I20260809 23:23:53.589877 27549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:53.586706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58212 (local address 127.1.235.189:35697)
0809 23:23:53.586750 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:53.586752 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:53.586980 (+ 228us) server_negotiation.cc:407] Connection header received
0809 23:23:53.587002 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:53.587003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:53.587014 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:53.587062 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:23:53.587269 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:53.587969 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:53.589083 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:53.589383 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:53.589453 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:53.589593 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:23:53.589624 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:23:53.589672 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:53.589759 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 23:23:53.589781 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260809 23:23:53.590413 27555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:53.586629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47730 (local address 127.1.235.188:33501)
0809 23:23:53.586687 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:53.586690 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:53.587139 (+ 449us) server_negotiation.cc:407] Connection header received
0809 23:23:53.587191 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:53.587192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:53.587203 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:53.587256 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:23:53.588235 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:53.588701 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:53.589657 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:53.589971 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:53.590047 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:53.590195 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:23:53.590222 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:23:53.590271 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:53.590323 (+ 52us) server_negotiation.cc:299] Negotiation successful
0809 23:23:53.590339 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 23:23:53.590524 27562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 23:23:53.586599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51410 (local address 127.1.235.190:44079)
0809 23:23:53.586725 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 23:23:53.586727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0809 23:23:53.586815 (+ 88us) server_negotiation.cc:407] Connection header received
0809 23:23:53.586902 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 23:23:53.586903 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 23:23:53.586940 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 23:23:53.587043 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 23:23:53.587205 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:53.588032 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:53.589489 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 23:23:53.589779 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 23:23:53.589920 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 23:23:53.590095 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 23:23:53.590185 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 23:23:53.590234 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0809 23:23:53.590373 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 23:23:53.590398 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":65,"threads_started":1}
I20260809 23:23:53.592283 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 27169
I20260809 23:23:53.605315 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 27253
I20260809 23:23:53.611119 1966 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskGyHluD/build/release/bin/kudu with pid 27334
2026-08-09T23:23:53Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2798 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5543 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (294464 ms total)
[ PASSED ] 54 tests.
[ FAILED ] 2 tests, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
[ FAILED ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
2 FAILED TESTS